-- Logs begin at Thu 2022-05-19 11:18:23 UTC, end at Thu 2022-05-19 12:51:42 UTC. -- May 19 11:50:19.942310 dv-cinder-804035-46-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 19 11:50:19.951249 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 11:50:19 2022] *** May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: nodename: dv-cinder-804035-46-iscsi May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: machine: x86_64 May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: clock source: unix May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: pcre jit disabled May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: detected number of CPU cores: 4 May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: current working directory: / May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: detected binary path: /usr/bin/uwsgi-core May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: your processes number limit is 47680 May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: your memory page size is 4096 bytes May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: detected max file descriptor number: 2048 May 19 11:50:19.953336 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: lock engine: pthread robust mutexes May 19 11:50:19.954100 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: thunder lock: enabled May 19 11:50:19.954100 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 11:50:19.954100 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 11:50:19.997220 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: Python main interpreter initialized at 0x5646db65c9c0 May 19 11:50:19.997220 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: python threads support enabled May 19 11:50:19.997220 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: your server socket listen backlog is limited to 100 connections May 19 11:50:19.997220 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: your mercy for graceful operations on workers is 90 seconds May 19 11:50:19.997565 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: mapped 403077 bytes (393 KB) for 2 cores May 19 11:50:19.997637 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: *** Operational MODE: preforking *** May 19 11:50:19.997886 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: *** uWSGI is running in multiple interpreter mode *** May 19 11:50:19.997886 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: spawned uWSGI master process (pid: 80203) May 19 11:50:19.998091 dv-cinder-804035-46-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 19 11:50:19.999473 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: spawned uWSGI worker 1 (pid: 80214, cores: 1) May 19 11:50:19.999473 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: spawned uWSGI worker 2 (pid: 80215, cores: 1) May 19 11:50:19.999473 dv-cinder-804035-46-iscsi devstack@keystone.service[80203]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 11:50:25.601910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:50:25.601910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes May 19 11:50:25.602654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:50:25.602654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: from cryptography.utils import int_from_bytes May 19 11:50:25.602654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:50:25.602654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: from cryptography.utils import int_from_bytes May 19 11:50:25.603143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:50:25.603143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes May 19 11:50:25.651186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 11:50:25.651368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 11:50:25.651443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 11:50:25.651521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] command line args: [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 11:50:25.651590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 11:50:25.651737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] command line args: [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 11:50:25.651875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 11:50:25.651963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ================================================================================ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 11:50:25.652037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 11:50:25.652112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ================================================================================ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 11:50:25.652204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] admin_token = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.652384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.652519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_dir = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.652599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.652700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_dir = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.652764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_source = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.652831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.653021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] debug = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.653181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_source = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.653181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] debug = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.653346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.654682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.654774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.654844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.654904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.654970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_config_append = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_config_append = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_dir = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_dir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.655959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656674 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.656943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.657908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.658137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.658255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.658344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.658423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.658790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.658925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.658925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] publish_errors = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] publish_errors = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.659928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] standard_threads = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] standard_threads = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.660939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_journal = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_journal = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_json = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_json = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_stderr = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_stderr = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_syslog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_syslog = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:50:25.661917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.662973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.663812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.664933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.665985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.666929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.667873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.668991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.669059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.669209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.669285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.669432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.669519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.669976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.670995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.671903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.672978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.673933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.674935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.675906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.676890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.677950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.678967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.679877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.680955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681829 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.681908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.682846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.683994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.684962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.685115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.685193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.685349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.685435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.685583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.685707 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.685943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.external = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686714 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.external = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.686948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.password = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.token = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.password = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.token = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.687892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.688992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.689991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.690922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.691876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.692895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.693989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.694974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.695909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.696859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.697923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.698925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.699858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.700880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.701930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.702934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.703864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.704937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.705862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.706841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.707995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.708930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709853 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.709998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.710969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.711918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.712859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.713935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.714931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.715899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.716988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717227 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.717929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.718932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.719853 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.720982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.721992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.722151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.722229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.722387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.722474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.722624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.722767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.722994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.723940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.724973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.725872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.726967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727656 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.727958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.728915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.729993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.730993 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.731171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.731249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.731462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.731541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.731696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.731788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.731935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.732952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.733870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.734931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 11:50:25.735822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:50:25.735980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 11:50:25.766611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.766761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.766983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.767171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.767403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.767627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.775637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.776295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.803790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.804031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.804476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.804734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.856400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.862274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.906887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.907084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.908473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.908692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.971316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.971509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.971718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.971926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.972078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.972166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.972246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.972319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.972396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.972570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.972767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.973013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.995174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.995401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.995497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.995562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.995622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.995805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.995930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.996012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.996086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.996191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.996278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.996399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.996578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:25.996686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.007603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.008040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.022976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.023039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.023236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.023359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.023443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.023603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:50:26.040232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.040465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:50:26.040792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.040969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:50:26.041063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.041239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:50:26.041376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.041480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.041569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.041744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:50:26.041869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.041967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.042055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.042257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.042507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.042750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.053197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.053471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.053735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.054003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.054147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.054300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.054569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.054843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.062008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.062918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.065242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.065491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.065788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.066161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.066305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.066406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.066496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.066690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.066816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.066924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.067979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.068071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.068304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.068567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.068853 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.093985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.095087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.095562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.095831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.096711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.097001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.101021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.101292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.101569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.102253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.102526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.102806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.108773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.109052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.110148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.110424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.113578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.113860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.114133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.114406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.114669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.114919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.115016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.115194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.115321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.115417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.115499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.115798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.116067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.116337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.116594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.116864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.133714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.133984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.135263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.135534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.138468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.140055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.142029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.142313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.143653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.143939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.147257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.148844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.150785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.152364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.154654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.154939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.155217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.155478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.155824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.156079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.156179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.156390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.156672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.156964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.157236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.157509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.175129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.175487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.175749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.176006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.176581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.176976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.177239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.177512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.183827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.185402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.185527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.185828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.187105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.187387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.188826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.189107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.189388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.189659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.189924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.190420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.190695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.190986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.191261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.191528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.203096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.203380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.203644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.203919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.204186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.204454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.204754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.204879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.205043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.205320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.205590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.205850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.206130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.206398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.222556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.224263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.225776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.227500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.229044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.230611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.230801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.232364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.232491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.232709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.232937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.234102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.234380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.234655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.240197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.241811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.241936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.243568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.244990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.245273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.245545 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.245811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.246809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.247096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.247375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.247643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.254858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.255140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.255409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.256777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.257059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.257543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.263218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.263498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.263762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.264022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.264285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.264512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.264833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.265090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.265332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:50:26.265461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.265598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.265720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.265837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.265924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.266117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.266257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.266393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.266473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.266586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.266677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.266892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.267128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.267400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.267672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.267943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.268199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.268466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.268726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:50:26.304921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646db65c9c0 pid: 80214 (default app) May 19 11:50:26.307100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646db65c9c0 pid: 80215 (default app) May 19 11:50:26.308177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b15de-02d2-4f66-961b-c1ec8c14700b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:26.308465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b15de-02d2-4f66-961b-c1ec8c14700b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:26.308758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b15de-02d2-4f66-961b-c1ec8c14700b None None] PATH_INFO: `/v3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:26.313043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 791 bytes} [Thu May 19 11:50:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:34.302928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48d49-1425-49e2-aea6-1a14939c28a3 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:34.303838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48d49-1425-49e2-aea6-1a14939c28a3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:34.303838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48d49-1425-49e2-aea6-1a14939c28a3 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:34.311050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1/2] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:34.316571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:34.317023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:34.317112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:34.385218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: INFO dbcounter [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] Registered counter for database keystone May 19 11:50:34.410259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 11:50:34.421821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writer thread running {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 11:50:34.597976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80214) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 11:50:34.598387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80214) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 11:50:34.654441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:34.656047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:34.793823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 2/3] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 11:50:34.969220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba48d49-1425-49e2-aea6-1a14939c28a3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:35.042564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: INFO dbcounter [None req-3ba48d49-1425-49e2-aea6-1a14939c28a3 None None] Registered counter for database keystone May 19 11:50:35.065269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG oslo_db.sqlalchemy.engines [None req-3ba48d49-1425-49e2-aea6-1a14939c28a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 11:50:35.079241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writer thread running {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 11:50:35.198547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba48d49-1425-49e2-aea6-1a14939c28a3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:35.203655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a8115-7ef6-400d-98ef-2459cb416c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:35.204309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a8115-7ef6-400d-98ef-2459cb416c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:35.204586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a8115-7ef6-400d-98ef-2459cb416c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:35.204880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a8115-7ef6-400d-98ef-2459cb416c75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:35.213234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a8115-7ef6-400d-98ef-2459cb416c75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:35.264251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b02a8115-7ef6-400d-98ef-2459cb416c75 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 11:50:35.264512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a8115-7ef6-400d-98ef-2459cb416c75 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:35.274477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 2/4] 10.222.0.35 () {58 vars in 1324 bytes} [Thu May 19 11:50:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 11:50:35.284487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:35.303882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb813b-7e8a-45a4-b4f7-eb75378bcc6e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:35.309745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f95fe0-54b0-4352-8da2-dd9c329b6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:35.310880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f95fe0-54b0-4352-8da2-dd9c329b6322 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:35.311174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f95fe0-54b0-4352-8da2-dd9c329b6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:35.311451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f95fe0-54b0-4352-8da2-dd9c329b6322 admin admin] PATH_INFO: `/v3/projects/f8b904bb5322427b8794f68069b5704c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:35.313020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f95fe0-54b0-4352-8da2-dd9c329b6322 admin admin] RBAC: Authorizing `identity:get_project(project_id=f8b904bb5322427b8794f68069b5704c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:35.473234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f8f95fe0-54b0-4352-8da2-dd9c329b6322 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 11:50:35.473941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f95fe0-54b0-4352-8da2-dd9c329b6322 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:35.478352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 3/5] 10.222.0.35 () {56 vars in 1207 bytes} [Thu May 19 11:50:35 2022] GET /identity/v3/projects/f8b904bb5322427b8794f68069b5704c => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:37.662149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a888-d5ca-4e02-9c70-3bb52b70fd56 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:37.663000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a888-d5ca-4e02-9c70-3bb52b70fd56 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:37.663000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a888-d5ca-4e02-9c70-3bb52b70fd56 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:37.669717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 3/6] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:37.675732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a231f-c772-4ae2-90ce-a03b7db81b42 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:37.676152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a231f-c772-4ae2-90ce-a03b7db81b42 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:37.676242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a231f-c772-4ae2-90ce-a03b7db81b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:37.697349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2f3a231f-c772-4ae2-90ce-a03b7db81b42 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:37.698870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f3a231f-c772-4ae2-90ce-a03b7db81b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:37.707865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 4/7] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 11:50:37.729848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792a888-d5ca-4e02-9c70-3bb52b70fd56 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:37.744928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792a888-d5ca-4e02-9c70-3bb52b70fd56 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:37.750223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a479d2-f62e-42a8-b4e3-811736b3f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:37.750845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a479d2-f62e-42a8-b4e3-811736b3f792 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:37.751125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a479d2-f62e-42a8-b4e3-811736b3f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:37.751394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a479d2-f62e-42a8-b4e3-811736b3f792 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:37.760146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a479d2-f62e-42a8-b4e3-811736b3f792 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:37.761896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a479d2-f62e-42a8-b4e3-811736b3f792 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:37.770943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 4/8] 10.222.0.35 () {58 vars in 1324 bytes} [Thu May 19 11:50:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 11:50:37.776879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a231f-c772-4ae2-90ce-a03b7db81b42 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:37.791859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a231f-c772-4ae2-90ce-a03b7db81b42 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:37.798856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2f27-663b-4ebf-a5e9-48fb8f8d3840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:37.799736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2f27-663b-4ebf-a5e9-48fb8f8d3840 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:37.800018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2f27-663b-4ebf-a5e9-48fb8f8d3840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:37.800293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2f27-663b-4ebf-a5e9-48fb8f8d3840 admin admin] PATH_INFO: `/v3/users/f3118ad2395a4a5ea5565be712f02917` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:37.801955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e2f27-663b-4ebf-a5e9-48fb8f8d3840 admin admin] RBAC: Authorizing `identity:get_user(user_id=f3118ad2395a4a5ea5565be712f02917)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:37.803822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e2f27-663b-4ebf-a5e9-48fb8f8d3840 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:37.805441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 5/9] 10.222.0.35 () {56 vars in 1198 bytes} [Thu May 19 11:50:37 2022] GET /identity/v3/users/f3118ad2395a4a5ea5565be712f02917 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:40.074610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898597ce-f722-46f4-acdf-f85e7e3f5761 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.075167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898597ce-f722-46f4-acdf-f85e7e3f5761 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.075167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898597ce-f722-46f4-acdf-f85e7e3f5761 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.076479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 5/10] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:50:40.081874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f0871-ca35-4d24-8534-9e9f20511293 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.082321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f0871-ca35-4d24-8534-9e9f20511293 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.082408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f0871-ca35-4d24-8534-9e9f20511293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.099959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-da9f0871-ca35-4d24-8534-9e9f20511293 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:40.101160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da9f0871-ca35-4d24-8534-9e9f20511293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:40.117065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806f565-0f9e-4652-8f35-69315f839de6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.117348 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806f565-0f9e-4652-8f35-69315f839de6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.117599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806f565-0f9e-4652-8f35-69315f839de6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.118950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 6/11] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:50:40.124271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.124552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.124850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.164721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG passlib.handlers.bcrypt [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80215) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 11:50:40.165147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG passlib.handlers.bcrypt [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80215) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 11:50:40.184139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 6/12] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:40.207260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f0871-ca35-4d24-8534-9e9f20511293 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.211576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:40.213193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:40.231499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:40.313243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 7/13] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:50:40.313925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f0871-ca35-4d24-8534-9e9f20511293 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:40.335060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.348683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:40.349498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.349781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.350058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.363873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:40.375494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:40.376628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:50:40.377482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 7/14] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:50:40.383089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.475895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:40.494294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951eec9-7c52-4b3a-861c-1fe26f65abbf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:40.529473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:40.530141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.530416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.530679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.531461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:40.531763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:40.533262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:40.545283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 8/15] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:50:40.551021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.551196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57d7c-7c34-4b67-b890-3b09293d8c6d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:40.553588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:40.588257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:40.589116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.589398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.589668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.650530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efe7f-26db-43d2-a6e4-2e711b62ce32 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:40.656412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:40.657992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:40.685083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:40.685969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.686249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.686523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] PATH_INFO: `/v3/users/f3118ad2395a4a5ea5565be712f02917` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.687739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] RBAC: Authorizing `identity:get_user(user_id=f3118ad2395a4a5ea5565be712f02917)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:40.689259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:40.690891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 9/16] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/users/f3118ad2395a4a5ea5565be712f02917 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:50:40.696281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.711093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:40.756310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 8/17] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:50:40.762325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.765067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:40.795402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241649-b4de-4da2-88c0-83f8a81faeab None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:40.828107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93519715-6190-448b-8586-7462aa470170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:40.828957 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93519715-6190-448b-8586-7462aa470170 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.829208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93519715-6190-448b-8586-7462aa470170 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.829473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93519715-6190-448b-8586-7462aa470170 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.830945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93519715-6190-448b-8586-7462aa470170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:40.832223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93519715-6190-448b-8586-7462aa470170 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:40.833862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 10/18] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:50:40.839619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93519715-6190-448b-8586-7462aa470170 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.860796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1688d-0ac4-400a-a6af-25dd46083f1e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:40.895484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:40.896274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.896552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.896851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.915426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:40.916895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:40.918671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:50:40.938173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:40.939036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:40.939842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:50:40.939842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:50:40.939842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:50:40.939842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:50:40.940189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93519715-6190-448b-8586-7462aa470170 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:40.940259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 9/19] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:50:40.945171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:40.971872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38920565-3df1-49d2-ac29-df541a451e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:40.972528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920565-3df1-49d2-ac29-df541a451e14 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:40.972832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920565-3df1-49d2-ac29-df541a451e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:40.973104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920565-3df1-49d2-ac29-df541a451e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:40.973933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38920565-3df1-49d2-ac29-df541a451e14 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.domain.id=default, user.id=f3118ad2395a4a5ea5565be712f02917) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:40.974243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38920565-3df1-49d2-ac29-df541a451e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:40.975683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38920565-3df1-49d2-ac29-df541a451e14 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:40.982667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 11/20] 10.222.0.35 () {56 vars in 1322 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/role_assignments?user.id=f3118ad2395a4a5ea5565be712f02917&scope.domain.id=default&role.id=aafa433396f14143bb549af1f2b6219b => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:41.006552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:41.056026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b08827-bc60-44a5-9fc5-49638df5d6e1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:41.094057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f1fe-055c-43db-b951-147f686d92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:41.094707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f1fe-055c-43db-b951-147f686d92a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:41.094900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f1fe-055c-43db-b951-147f686d92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:41.095170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f1fe-055c-43db-b951-147f686d92a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:41.095911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f1fe-055c-43db-b951-147f686d92a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:41.096218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f1fe-055c-43db-b951-147f686d92a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:41.097802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f1fe-055c-43db-b951-147f686d92a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:41.117113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 10/21] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:50:43.516297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdac9-490c-47a9-b95b-881acb9b4439 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:43.516832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdac9-490c-47a9-b95b-881acb9b4439 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:43.516905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdac9-490c-47a9-b95b-881acb9b4439 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:43.518390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 12/22] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:43.523972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e85b-3672-469b-bb63-92594c5a0a98 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:43.524402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e85b-3672-469b-bb63-92594c5a0a98 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:43.524537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e85b-3672-469b-bb63-92594c5a0a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:43.547655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e483e85b-3672-469b-bb63-92594c5a0a98 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:43.549105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e483e85b-3672-469b-bb63-92594c5a0a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:43.623327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 11/23] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:43.659090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdac9-490c-47a9-b95b-881acb9b4439 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:43.788866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdac9-490c-47a9-b95b-881acb9b4439 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:43.834825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0244cc-7fe0-45ae-b03d-44d6ebaa8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:43.835925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0244cc-7fe0-45ae-b03d-44d6ebaa8e7e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:43.836359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0244cc-7fe0-45ae-b03d-44d6ebaa8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:43.836821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0244cc-7fe0-45ae-b03d-44d6ebaa8e7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:43.848292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0244cc-7fe0-45ae-b03d-44d6ebaa8e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8c0244cc-7fe0-45ae-b03d-44d6ebaa8e7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:43.856252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:43.857315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:43.858269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:50:43.860601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 13/24] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:50:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:50:43.869938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e85b-3672-469b-bb63-92594c5a0a98 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:43.925033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:43.995120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3861b-d503-4354-bec9-a1decb6bae49 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:43.995433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3861b-d503-4354-bec9-a1decb6bae49 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:43.995681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3861b-d503-4354-bec9-a1decb6bae49 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:43.997296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 14/25] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:43.998890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e85b-3672-469b-bb63-92594c5a0a98 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:44.002483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc566-ac7a-401b-b12c-0e6fec053998 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.002764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc566-ac7a-401b-b12c-0e6fec053998 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.003040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc566-ac7a-401b-b12c-0e6fec053998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.018789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:44.042298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-03fcc566-ac7a-401b-b12c-0e6fec053998 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:44.043452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03fcc566-ac7a-401b-b12c-0e6fec053998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:44.091575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:44.092350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.092659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.092928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.093718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:44.094037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:44.095549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:44.118342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 12/26] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:44.123934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:44.189615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 15/27] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:50:44.269709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcc566-ac7a-401b-b12c-0e6fec053998 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:44.275290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826d291-72d8-4b58-af80-d74400ae4da4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:44.285536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:44.328992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:44.329888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.330166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.330438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] PATH_INFO: `/v3/users/f3118ad2395a4a5ea5565be712f02917` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.333170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] RBAC: Authorizing `identity:get_user(user_id=f3118ad2395a4a5ea5565be712f02917)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:44.334665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:44.339218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 13/28] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:44 2022] GET /identity/v3/users/f3118ad2395a4a5ea5565be712f02917 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:50:44.346431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:44.461756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcc566-ac7a-401b-b12c-0e6fec053998 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:44.528821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39729f81-3bf8-407a-a89d-3d29a3735a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:44.530150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729f81-3bf8-407a-a89d-3d29a3735a56 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.530433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729f81-3bf8-407a-a89d-3d29a3735a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.530710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729f81-3bf8-407a-a89d-3d29a3735a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.531486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39729f81-3bf8-407a-a89d-3d29a3735a56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:44.534343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39729f81-3bf8-407a-a89d-3d29a3735a56 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:44.537030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:44.541318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134902-ce50-4a6b-970c-aae27ba87150 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:44.586772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf52928-2f83-429e-b5cf-9fa7cd7181bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:44.587979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf52928-2f83-429e-b5cf-9fa7cd7181bb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.588561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf52928-2f83-429e-b5cf-9fa7cd7181bb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.589091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf52928-2f83-429e-b5cf-9fa7cd7181bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.590692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf52928-2f83-429e-b5cf-9fa7cd7181bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:44.592554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf52928-2f83-429e-b5cf-9fa7cd7181bb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:44.594666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 14/29] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:44.599910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09748741-d918-46e6-95a5-6e673026acba None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.600435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09748741-d918-46e6-95a5-6e673026acba None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.600927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09748741-d918-46e6-95a5-6e673026acba None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.605819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 15/30] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:44.606947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09748741-d918-46e6-95a5-6e673026acba None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:44.693330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 16/31] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 11:50:44 2022] POST /identity/v3/roles => generated 219 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:50:44.694838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e8a3-861d-48f0-a76a-b03458ffa181 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.695125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e8a3-861d-48f0-a76a-b03458ffa181 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.695396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7e8a3-861d-48f0-a76a-b03458ffa181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.704007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:44.733750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-edd7e8a3-861d-48f0-a76a-b03458ffa181 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:44.735330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-edd7e8a3-861d-48f0-a76a-b03458ffa181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:44.809841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09748741-d918-46e6-95a5-6e673026acba None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:44.849067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 17/32] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:44.851121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb7192-dd69-414a-9007-18d2f90590cf None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.851651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb7192-dd69-414a-9007-18d2f90590cf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.852147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb7192-dd69-414a-9007-18d2f90590cf None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.855560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 18/33] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:44.861541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd11f-9f3d-4b77-84c1-e3f323a63889 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.862133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd11f-9f3d-4b77-84c1-e3f323a63889 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.862605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd11f-9f3d-4b77-84c1-e3f323a63889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.892623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-08ebd11f-9f3d-4b77-84c1-e3f323a63889 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:44.894246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-08ebd11f-9f3d-4b77-84c1-e3f323a63889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:44.897179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc67a0-6f51-4153-847e-f1ad58754e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:44.898685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc67a0-6f51-4153-847e-f1ad58754e46 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.898685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc67a0-6f51-4153-847e-f1ad58754e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.898872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc67a0-6f51-4153-847e-f1ad58754e46 None admin] PATH_INFO: `/v3/domains/default/users/f3118ad2395a4a5ea5565be712f02917/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.901952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc67a0-6f51-4153-847e-f1ad58754e46 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f3118ad2395a4a5ea5565be712f02917, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:44.903660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc67a0-6f51-4153-847e-f1ad58754e46 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:44.979495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 19/34] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:44.981397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87be22-b487-4e83-9fd7-d0b0b8306be6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:44.981907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87be22-b487-4e83-9fd7-d0b0b8306be6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:44.982373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87be22-b487-4e83-9fd7-d0b0b8306be6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:44.983836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 20/35] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:44.984779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87be22-b487-4e83-9fd7-d0b0b8306be6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:45.039513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 16/36] 10.222.0.35 () {58 vars in 1361 bytes} [Thu May 19 11:50:44 2022] PUT /identity/v3/domains/default/users/f3118ad2395a4a5ea5565be712f02917/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:50:45.041354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a00a0-0f3c-4998-9da4-4e1ceec1a18b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.041646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a00a0-0f3c-4998-9da4-4e1ceec1a18b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.041921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a00a0-0f3c-4998-9da4-4e1ceec1a18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.057025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:45.061808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-487a00a0-0f3c-4998-9da4-4e1ceec1a18b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:45.063575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-487a00a0-0f3c-4998-9da4-4e1ceec1a18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:45.109749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87be22-b487-4e83-9fd7-d0b0b8306be6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:45.140350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 17/37] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:45.141127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a00a0-0f3c-4998-9da4-4e1ceec1a18b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:45.154311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:45.155806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.156469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.157049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.170862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:45.173073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:45.182745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:50:45.206173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:45.207057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:45.207865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:50:45.207865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:50:45.207865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:50:45.207865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:50:45.215182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 21/38] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:50:45.216600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:45.257569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a00a0-0f3c-4998-9da4-4e1ceec1a18b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:45.300544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:45.301465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.301908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.302463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.303224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:45.304987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:45.325485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 18/39] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 11:50:45 2022] POST /identity/v3/roles => generated 225 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:50:45.326383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:45.334754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e1fb5-749b-4751-83a3-8d43ade29d57 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:45.351539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:45.393442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0f92e-9ef2-44c4-83a4-4e0c7503948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:45.394754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f92e-9ef2-44c4-83a4-4e0c7503948d None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.395039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f92e-9ef2-44c4-83a4-4e0c7503948d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.395487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f92e-9ef2-44c4-83a4-4e0c7503948d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.396414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0f92e-9ef2-44c4-83a4-4e0c7503948d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:45.398695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0f92e-9ef2-44c4-83a4-4e0c7503948d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:45.418386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 22/40] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 11:50:45 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:50:45.420333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9553457-f47b-459f-bd6c-c1ed4097bd1d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.420627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9553457-f47b-459f-bd6c-c1ed4097bd1d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.420954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9553457-f47b-459f-bd6c-c1ed4097bd1d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.422398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 23/41] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:45.432034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316baa-a897-4c1d-a1fa-2aa36ac00f50 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.432346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316baa-a897-4c1d-a1fa-2aa36ac00f50 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.432587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316baa-a897-4c1d-a1fa-2aa36ac00f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.468507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-13316baa-a897-4c1d-a1fa-2aa36ac00f50 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:45.470132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13316baa-a897-4c1d-a1fa-2aa36ac00f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:45.480669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:45.480870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29593b04-aa9e-4597-ac4b-46ef99b67f42 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:45.529599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:45.532669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.532669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.532669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.532669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:45.532669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:45.534212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:45.550776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 19/42] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:45.557271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:45.623849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 24/43] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:45.647756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316baa-a897-4c1d-a1fa-2aa36ac00f50 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:45.698477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942f8e-47df-4431-b506-5f0ebb4357d2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:45.739621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:45.740299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.740584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.740888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.741615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:45.743086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:45.772243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:45.778544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 20/44] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:50:45 2022] POST /identity/v3/projects => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:50:45.779727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316baa-a897-4c1d-a1fa-2aa36ac00f50 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:45.819116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2fe1d-9d63-4fcf-a368-8ff98ddb6dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:45.819933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2fe1d-9d63-4fcf-a368-8ff98ddb6dfe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.820213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2fe1d-9d63-4fcf-a368-8ff98ddb6dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.820486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2fe1d-9d63-4fcf-a368-8ff98ddb6dfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.821774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2fe1d-9d63-4fcf-a368-8ff98ddb6dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:45.823269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2fe1d-9d63-4fcf-a368-8ff98ddb6dfe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:45.825249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 25/45] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:50:45.830672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:45.840605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:45.936305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce624f0-93c3-4568-afb0-a7864f0ba221 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:45.971831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cd39b-1f1b-42cf-b107-141a05fd3519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:45.972503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cd39b-1f1b-42cf-b107-141a05fd3519 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:45.972816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cd39b-1f1b-42cf-b107-141a05fd3519 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:45.973092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cd39b-1f1b-42cf-b107-141a05fd3519 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:45.973806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cd39b-1f1b-42cf-b107-141a05fd3519 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:45.975292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cd39b-1f1b-42cf-b107-141a05fd3519 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:46.005562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 21/46] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:50:45 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:50:47.333964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0b15-1fbc-44e4-91e5-815c37796796 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:47.334527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0b15-1fbc-44e4-91e5-815c37796796 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:47.334527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0b15-1fbc-44e4-91e5-815c37796796 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:47.335978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 26/47] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:47.341697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4c842-45b6-43bc-8261-c1268c62187b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:47.342074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4c842-45b6-43bc-8261-c1268c62187b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:47.342253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4c842-45b6-43bc-8261-c1268c62187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:47.360070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-08b4c842-45b6-43bc-8261-c1268c62187b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:47.361292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-08b4c842-45b6-43bc-8261-c1268c62187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:47.416318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:47.431275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 22/48] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:47.457744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b0b15-1fbc-44e4-91e5-815c37796796 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:47.568240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b0b15-1fbc-44e4-91e5-815c37796796 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:47.603328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:47.604043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:47.604322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:47.604596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:47.615356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:47.622960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:47.623799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:50:47.624575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 27/49] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:50:47.630267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4c842-45b6-43bc-8261-c1268c62187b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:47.735318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4c842-45b6-43bc-8261-c1268c62187b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:47.772571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:47.773268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:47.773548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:47.773822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:47.774576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:47.774880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:47.776276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:47.784583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 23/50] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:47.790220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:47.816761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:47.897192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d18ea-9b89-4185-8373-713514d3a6d2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:47.931583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:47.932478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:47.932790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:47.933062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] PATH_INFO: `/v3/users/f3118ad2395a4a5ea5565be712f02917` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:47.934282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] RBAC: Authorizing `identity:get_user(user_id=f3118ad2395a4a5ea5565be712f02917)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:47.935760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:47.937459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 28/51] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:47 2022] GET /identity/v3/users/f3118ad2395a4a5ea5565be712f02917 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:47.943106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:47.994607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:48.050740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29d12-6a4d-4cdf-9ad2-17141bab0ac2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:48.085098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928749dc-fa46-4347-ab3b-c53d5baed9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:48.085893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928749dc-fa46-4347-ab3b-c53d5baed9dc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:48.086176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928749dc-fa46-4347-ab3b-c53d5baed9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:48.086447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928749dc-fa46-4347-ab3b-c53d5baed9dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:48.087631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928749dc-fa46-4347-ab3b-c53d5baed9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:48.089128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928749dc-fa46-4347-ab3b-c53d5baed9dc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:48.091017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 24/52] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:48.096960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:48.188529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a291b4-0dcc-4b94-ac25-7236fb20108e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:48.188789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a291b4-0dcc-4b94-ac25-7236fb20108e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:48.189056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a291b4-0dcc-4b94-ac25-7236fb20108e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:48.190449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 25/53] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:50:48.191390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:48.195548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df31adc-3cc5-448d-9036-1c9adec8eaeb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:48.195832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df31adc-3cc5-448d-9036-1c9adec8eaeb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:48.196111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df31adc-3cc5-448d-9036-1c9adec8eaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:48.201301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb7e4-3152-40fc-b149-2b079109b67d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:48.213351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4df31adc-3cc5-448d-9036-1c9adec8eaeb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:48.214559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4df31adc-3cc5-448d-9036-1c9adec8eaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:48.235760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:48.236417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:48.236757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:48.237027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:48.237898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.domain.id=default, user.id=f3118ad2395a4a5ea5565be712f02917) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:48.238211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:48.239669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:48.245762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 29/54] 10.222.0.35 () {56 vars in 1322 bytes} [Thu May 19 11:50:48 2022] GET /identity/v3/role_assignments?user.id=f3118ad2395a4a5ea5565be712f02917&scope.domain.id=default&role.id=aafa433396f14143bb549af1f2b6219b => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:48.283594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 26/55] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:50:48.307445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:48.415583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314e640-1b93-4e99-9e2b-2151203cd7e8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:48.451781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5ec5c-6b4c-4fdd-9191-cdac7bcfe567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:48.452521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ec5c-6b4c-4fdd-9191-cdac7bcfe567 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:48.452844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ec5c-6b4c-4fdd-9191-cdac7bcfe567 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:48.453121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ec5c-6b4c-4fdd-9191-cdac7bcfe567 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:48.454318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5ec5c-6b4c-4fdd-9191-cdac7bcfe567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:48.455802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5ec5c-6b4c-4fdd-9191-cdac7bcfe567 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:48.457619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 30/56] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:48.463540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df31adc-3cc5-448d-9036-1c9adec8eaeb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:48.515990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:48.567320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df31adc-3cc5-448d-9036-1c9adec8eaeb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:48.606172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbea4f-bf8a-4573-b9b5-053c9397ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:48.606834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbea4f-bf8a-4573-b9b5-053c9397ac8a None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:48.607116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbea4f-bf8a-4573-b9b5-053c9397ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:48.607393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbea4f-bf8a-4573-b9b5-053c9397ac8a None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:48.608121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbea4f-bf8a-4573-b9b5-053c9397ac8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:48.609618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbea4f-bf8a-4573-b9b5-053c9397ac8a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:48.638327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 27/57] 10.222.0.35 () {60 vars in 1140 bytes} [Thu May 19 11:50:48 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:50:50.843041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792ab09-6bb1-4b68-a8a4-ec53ecfe280c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:50.843881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792ab09-6bb1-4b68-a8a4-ec53ecfe280c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:50.843967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792ab09-6bb1-4b68-a8a4-ec53ecfe280c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:50.846371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 31/58] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:50.855335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60f6a-c11c-4c1c-9428-24b35edc1e5c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:50.855761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60f6a-c11c-4c1c-9428-24b35edc1e5c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:50.856085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60f6a-c11c-4c1c-9428-24b35edc1e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:50.876098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-82e60f6a-c11c-4c1c-9428-24b35edc1e5c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:50.877306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-82e60f6a-c11c-4c1c-9428-24b35edc1e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:50.948183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 28/59] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:50.985544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792ab09-6bb1-4b68-a8a4-ec53ecfe280c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:51.022840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:51.112574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792ab09-6bb1-4b68-a8a4-ec53ecfe280c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:51.147637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcefa4-b372-4020-9915-8641b3cb27f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:51.148434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcefa4-b372-4020-9915-8641b3cb27f1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:51.148723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcefa4-b372-4020-9915-8641b3cb27f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:51.149020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcefa4-b372-4020-9915-8641b3cb27f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:51.150310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcefa4-b372-4020-9915-8641b3cb27f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:51.151763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcefa4-b372-4020-9915-8641b3cb27f1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:51.153448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 32/60] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:51.162482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60f6a-c11c-4c1c-9428-24b35edc1e5c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:51.200742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:51.279968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60f6a-c11c-4c1c-9428-24b35edc1e5c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:51.318192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e3d8c-4e05-45af-8ad2-bcfefcf2fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:51.318854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e3d8c-4e05-45af-8ad2-bcfefcf2fd98 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:51.319133 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e3d8c-4e05-45af-8ad2-bcfefcf2fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:51.319402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e3d8c-4e05-45af-8ad2-bcfefcf2fd98 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:51.320111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e3d8c-4e05-45af-8ad2-bcfefcf2fd98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:51.321603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e3d8c-4e05-45af-8ad2-bcfefcf2fd98 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:51.350536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 29/61] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:50:51 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:50:54.606625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4c619-82af-4792-b69a-95413b9997d1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:54.607583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4c619-82af-4792-b69a-95413b9997d1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:54.608045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4c619-82af-4792-b69a-95413b9997d1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:54.609681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 33/62] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:54.615120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d220-bd7d-4c8d-be71-aa8576293243 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:54.615550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d220-bd7d-4c8d-be71-aa8576293243 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:54.615676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7d220-bd7d-4c8d-be71-aa8576293243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:54.636735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3ab7d220-bd7d-4c8d-be71-aa8576293243 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:54.638144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3ab7d220-bd7d-4c8d-be71-aa8576293243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:54.695336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab58ad1-d9af-46b7-92ed-31a05404e734 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:54.695983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab58ad1-d9af-46b7-92ed-31a05404e734 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:54.696312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab58ad1-d9af-46b7-92ed-31a05404e734 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:54.697904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 34/63] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:54.703760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227236da-9986-40b4-b9c7-ab29447775b1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:54.704329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227236da-9986-40b4-b9c7-ab29447775b1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:54.704832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227236da-9986-40b4-b9c7-ab29447775b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:54.722367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 30/64] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:54.731252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-227236da-9986-40b4-b9c7-ab29447775b1 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:54.732733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-227236da-9986-40b4-b9c7-ab29447775b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:54.772584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d220-bd7d-4c8d-be71-aa8576293243 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:54.794572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:54.825698 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 35/65] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:50:54.849987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227236da-9986-40b4-b9c7-ab29447775b1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:54.895536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:54.982780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7d220-bd7d-4c8d-be71-aa8576293243 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.033199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227236da-9986-40b4-b9c7-ab29447775b1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.061695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.061695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.061695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.061695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.091109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:55.099682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.100488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.100793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.101067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:55.107232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:55.108075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:50:55.109296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 31/66] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:50:55.116316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.125198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:55.139182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:55.140057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:50:55.140845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:50:55.144250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 36/67] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:50:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:50:55.150122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.240399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.265012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3a528-415b-4293-88e2-bc1325727839 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.269925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.289858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9959-a874-47fc-beab-f4bb96df5095 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.300686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f82078-576b-46f1-99fa-0ff22671c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.301542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f82078-576b-46f1-99fa-0ff22671c085 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.301833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f82078-576b-46f1-99fa-0ff22671c085 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.302140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f82078-576b-46f1-99fa-0ff22671c085 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.302893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f82078-576b-46f1-99fa-0ff22671c085 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:55.303201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f82078-576b-46f1-99fa-0ff22671c085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:55.304600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f82078-576b-46f1-99fa-0ff22671c085 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:55.312826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 32/68] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:55.314045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ca8a6-1e3e-4746-9335-8413a7529fb2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.314330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ca8a6-1e3e-4746-9335-8413a7529fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.314605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ca8a6-1e3e-4746-9335-8413a7529fb2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.315823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 33/69] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:55.316900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b41f-ba37-491f-9be4-24673c646339 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.317166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b41f-ba37-491f-9be4-24673c646339 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.317433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b41f-ba37-491f-9be4-24673c646339 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.318636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 34/70] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:55.319820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066187aa-27d9-4a2c-af6b-d7e98244b48f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.320283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066187aa-27d9-4a2c-af6b-d7e98244b48f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.320558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066187aa-27d9-4a2c-af6b-d7e98244b48f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.321918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 35/71] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:55.322488 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066187aa-27d9-4a2c-af6b-d7e98244b48f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.333525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f353-5e23-4fc6-870b-b58b7f690ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.334202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f353-5e23-4fc6-870b-b58b7f690ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.334488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f353-5e23-4fc6-870b-b58b7f690ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.334765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f353-5e23-4fc6-870b-b58b7f690ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.335539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f353-5e23-4fc6-870b-b58b7f690ff5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:55.335846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f353-5e23-4fc6-870b-b58b7f690ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:55.337290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f353-5e23-4fc6-870b-b58b7f690ff5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:55.345546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 37/72] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:50:55.346883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7f13a-0b93-4d27-adb5-d2ba748ce347 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.347176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7f13a-0b93-4d27-adb5-d2ba748ce347 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.347456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7f13a-0b93-4d27-adb5-d2ba748ce347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.363394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b5e7f13a-0b93-4d27-adb5-d2ba748ce347 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:55.364605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b5e7f13a-0b93-4d27-adb5-d2ba748ce347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:55.427211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066187aa-27d9-4a2c-af6b-d7e98244b48f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.431366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 38/73] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:55.432630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0edd88-508a-4624-9cb3-5b5bddf8c938 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.432949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0edd88-508a-4624-9cb3-5b5bddf8c938 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.433229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0edd88-508a-4624-9cb3-5b5bddf8c938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.449503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6c0edd88-508a-4624-9cb3-5b5bddf8c938 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:55.450700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6c0edd88-508a-4624-9cb3-5b5bddf8c938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:55.464210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8d83-15ed-40dc-9027-d4ab00ef8b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.465163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8d83-15ed-40dc-9027-d4ab00ef8b01 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.465440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8d83-15ed-40dc-9027-d4ab00ef8b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.465711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8d83-15ed-40dc-9027-d4ab00ef8b01 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.473369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.481641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8d83-15ed-40dc-9027-d4ab00ef8b01 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:55.483113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8d83-15ed-40dc-9027-d4ab00ef8b01 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:55.484843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 36/74] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:55.486024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552900dd-513c-4098-bc8d-8a1916e3e7c3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.486307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552900dd-513c-4098-bc8d-8a1916e3e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.486587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552900dd-513c-4098-bc8d-8a1916e3e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.502447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-552900dd-513c-4098-bc8d-8a1916e3e7c3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:55.503633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-552900dd-513c-4098-bc8d-8a1916e3e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:55.519472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 39/75] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:55.532962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0edd88-508a-4624-9cb3-5b5bddf8c938 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.532962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.573796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 37/76] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:55.574778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552900dd-513c-4098-bc8d-8a1916e3e7c3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.626371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0edd88-508a-4624-9cb3-5b5bddf8c938 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.660484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.661397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.661682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.661957 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] PATH_INFO: `/v3/users/f3118ad2395a4a5ea5565be712f02917` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.663164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] RBAC: Authorizing `identity:get_user(user_id=f3118ad2395a4a5ea5565be712f02917)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:55.664630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:55.666301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 40/77] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/users/f3118ad2395a4a5ea5565be712f02917 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:55.667067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.672788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552900dd-513c-4098-bc8d-8a1916e3e7c3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.697811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.706633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.707511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.707794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.708069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.718172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:55.726234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:55.727231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 38/78] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:50:55.733055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.738465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.768023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bec56-97b0-4cf0-8d0a-225b9a9d0faf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.803925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.804577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.804894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.805175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.832252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ecefd-5753-4e55-a8a2-fc2cf472c436 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:55.865065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:55.865856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:55.866142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:55.866415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:55.873133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:55.874619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:55.876295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:55.884003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:55.884927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:50:55.885895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 39/79] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:50:55.886952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.931992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.946315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:55.976334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 41/80] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:50:55.977215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:55.990293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3c530-5238-415b-9ce5-aeec3609d73a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.025410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.026279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.026558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.026835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.028091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.029611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.031254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 40/81] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.033249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.079425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0a72-0e4f-43e6-aa70-28acf4f07937 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.117879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.118471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.118758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.119034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.132140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b18ca-dd76-4e1a-965e-62266e5626f0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.145555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.160331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.165899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.166563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.166847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.167114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.167907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:56.168199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.169960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.177745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 41/82] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.178528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.192546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.194081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.275920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396db1-86e7-4b8e-b0c8-89c5178dc36a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.295271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 42/83] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:50:56.296364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.312815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.313464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.313750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.314024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.314775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:56.315081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.316500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.324897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 42/84] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.325662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.366060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.368113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.397014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef338aa-a64a-40f6-bc05-bc5362d05269 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.424283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8305ce8-7a9a-4fd3-82fa-f7c7324ecf20 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.431164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.432031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.432310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.432880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.433915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.435383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.437272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 43/85] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.437863 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.456745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.457416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.457696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.457970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.458676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.460138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.483068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 43/86] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:50:56 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:50:56.483876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.551521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789bdb5-4a4a-42bd-b0e4-63a8a941ed3d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.591095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.591980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.592268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.592544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.593833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.595318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.597119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 44/87] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.597927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.602593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.611180 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.612884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a50a9-f78b-4aca-babd-7da278318a0d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.651881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.652914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.653224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.653485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.654992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.656518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.663231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 44/88] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.663231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.718022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebffd3-8960-491c-940b-c6ff533a5a15 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.762735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.763634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.763912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.764185 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.765492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.766970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.768621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 45/89] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.769405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.775134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865de5d-6a38-47ae-98cb-804b28b733cd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.823605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.824360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.824717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.825006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.825862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=e3a33f6fa8494faea3791a72c2203e54) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:56.826174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:56.827637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:56.837296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 45/90] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/role_assignments?user.id=e3a33f6fa8494faea3791a72c2203e54&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=36180a439e5845b8b09129d2ba66c697 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:56.845639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:56.854526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.882465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4524-b81a-40ee-875b-3b6953b9de48 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:56.890239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:56.922370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:56.922957 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:56.923240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:56.923582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:56.980427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f4977-6285-4655-83ca-9a04d36060b6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:57.015315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:57.016668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:57.016886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:57.017340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:57.017666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:57.017954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:57.018805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=f3118ad2395a4a5ea5565be712f02917) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:57.019120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:57.020586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:57.027118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 46/91] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/role_assignments?user.id=f3118ad2395a4a5ea5565be712f02917&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:57.027845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:57.121811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:57.128795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:57.145531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aa9b8-60db-476d-a857-0893175cd551 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:57.154908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 46/92] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:50:57.160537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:57.185380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:57.186114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:57.186497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:57.186844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:57.262276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:57.263766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:57.272310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569cad-1611-429e-9057-95b85f36ec49 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:57.309726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:57.310599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:57.310877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:57.311147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:57.312387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:57.313921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:57.316037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 47/93] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:50:57 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:57.321717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:57.363785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:57.372600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:57.376700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 47/94] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:50:57.383015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:57.434902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251241-682a-4c80-909f-4b7089bb8589 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:57.470250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:57.470901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:57.471170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:57.471440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:57.472349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] RBAC: Adding query filter params (role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=e3a33f6fa8494faea3791a72c2203e54) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:57.472681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:57.474150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:57.480313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 48/95] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:50:57 2022] GET /identity/v3/role_assignments?user.id=e3a33f6fa8494faea3791a72c2203e54&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:57.501861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e60c0d-dfbf-47d0-80ff-4059aa5aa7d0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:57.538806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c8c2d-029d-4771-9e85-aaf4a0e22685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:57.539697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8c2d-029d-4771-9e85-aaf4a0e22685 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:57.539983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8c2d-029d-4771-9e85-aaf4a0e22685 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:57.540260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8c2d-029d-4771-9e85-aaf4a0e22685 None admin] PATH_INFO: `/v3/projects/7536603886574e59a75f34716a6eb711` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:57.541627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c8c2d-029d-4771-9e85-aaf4a0e22685 None admin] RBAC: Authorizing `identity:get_project(project_id=7536603886574e59a75f34716a6eb711)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:57.543222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c8c2d-029d-4771-9e85-aaf4a0e22685 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:57.546096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 48/96] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:50:57 2022] GET /identity/v3/projects/7536603886574e59a75f34716a6eb711 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:57.560535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:57.691883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4107-e6bc-4854-8fac-3329c4fefd13 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:57.701849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:57.729403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49050c-b45e-4606-9f14-a6bc64489c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:57.730017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49050c-b45e-4606-9f14-a6bc64489c7d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:57.730331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49050c-b45e-4606-9f14-a6bc64489c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:57.730615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49050c-b45e-4606-9f14-a6bc64489c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:57.731484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49050c-b45e-4606-9f14-a6bc64489c7d None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=7536603886574e59a75f34716a6eb711, user.id=e3a33f6fa8494faea3791a72c2203e54) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:57.731806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49050c-b45e-4606-9f14-a6bc64489c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:57.733297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49050c-b45e-4606-9f14-a6bc64489c7d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:57.739861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 49/97] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:50:57 2022] GET /identity/v3/role_assignments?user.id=e3a33f6fa8494faea3791a72c2203e54&scope.project.id=7536603886574e59a75f34716a6eb711&role.id=36180a439e5845b8b09129d2ba66c697 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:59.373736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14983-cbb6-4b8b-84a7-2b0f6595289a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:59.374311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14983-cbb6-4b8b-84a7-2b0f6595289a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:59.374311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14983-cbb6-4b8b-84a7-2b0f6595289a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:59.375690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 49/98] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:50:59.381480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300686-c265-488c-b6f8-4a9538caa7a4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:59.382332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300686-c265-488c-b6f8-4a9538caa7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:59.382821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300686-c265-488c-b6f8-4a9538caa7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:59.399882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2a300686-c265-488c-b6f8-4a9538caa7a4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:50:59.401446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2a300686-c265-488c-b6f8-4a9538caa7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:50:59.509269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 50/99] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:50:59.546111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14983-cbb6-4b8b-84a7-2b0f6595289a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:59.624454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:59.676079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14983-cbb6-4b8b-84a7-2b0f6595289a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:59.726230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:59.727032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:59.727317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:59.727593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:59.739184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:50:59.751242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:50:59.752396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:50:59.753430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:50:59.755952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 50/100] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:50:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:50:59.761704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a300686-c265-488c-b6f8-4a9538caa7a4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:50:59.904503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a300686-c265-488c-b6f8-4a9538caa7a4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:50:59.905980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:50:59.954723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41f8c-c4fe-4ae4-a029-14631c1ca845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:50:59.955413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41f8c-c4fe-4ae4-a029-14631c1ca845 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:50:59.955688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41f8c-c4fe-4ae4-a029-14631c1ca845 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:50:59.955976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41f8c-c4fe-4ae4-a029-14631c1ca845 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:50:59.956739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41f8c-c4fe-4ae4-a029-14631c1ca845 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:50:59.957049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41f8c-c4fe-4ae4-a029-14631c1ca845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:50:59.958446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d41f8c-c4fe-4ae4-a029-14631c1ca845 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:50:59.972872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 51/101] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:50:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:50:59.978662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:00.088664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4f524-5a32-4b3a-a161-6280c22b4163 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.088664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4f524-5a32-4b3a-a161-6280c22b4163 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.088664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4f524-5a32-4b3a-a161-6280c22b4163 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.088664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 52/102] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:00.102092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f4bd-37fd-42d3-ab88-07908405adab None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.102413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f4bd-37fd-42d3-ab88-07908405adab None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.102644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f4bd-37fd-42d3-ab88-07908405adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.125874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2ce0f4bd-37fd-42d3-ab88-07908405adab None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:00.127066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2ce0f4bd-37fd-42d3-ab88-07908405adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:00.143138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7bd7-55b0-4cfd-a536-0c398aca6285 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:00.173217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:00.207989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:00.208902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.209187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.209462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] PATH_INFO: `/v3/users/112a9f5ef83949819c2a66d10f5cd671` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.234646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] RBAC: Authorizing `identity:get_user(user_id=112a9f5ef83949819c2a66d10f5cd671)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:00.236144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:00.237958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 51/103] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:50:59 2022] GET /identity/v3/users/112a9f5ef83949819c2a66d10f5cd671 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:00.244948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:00.262756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 53/104] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:00.289578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42ac2d-0fee-4e64-8c0f-263f77e6914f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.289884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42ac2d-0fee-4e64-8c0f-263f77e6914f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.290189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42ac2d-0fee-4e64-8c0f-263f77e6914f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.291845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 54/105] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:00.299812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84a11-dbb7-4dad-b168-8c26cb354293 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.300405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84a11-dbb7-4dad-b168-8c26cb354293 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.300930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84a11-dbb7-4dad-b168-8c26cb354293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.327133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1ce84a11-dbb7-4dad-b168-8c26cb354293 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:00.328324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1ce84a11-dbb7-4dad-b168-8c26cb354293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:00.405123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5c26-9f9a-4452-917f-cf56a1dfc9f3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:00.441696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:00.442693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.443266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.443744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.465187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 55/106] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:00.466023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84a11-dbb7-4dad-b168-8c26cb354293 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:00.495368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:00.517715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:00.577170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:00.578670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:00.593554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84a11-dbb7-4dad-b168-8c26cb354293 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:00.635738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:00.636852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.637138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.637421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.650263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:00.659711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:00.660574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:00.661356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 56/107] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:00.661972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:00.763068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 52/108] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:00.763747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:00.797003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:00.829643 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02171c7-5803-4eb4-bdbd-430173e1c2c6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:00.844229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:00.877063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:00.878118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.878408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.878683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.880430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:00.882300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:00.884983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 57/109] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:00.885875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2fd07-69c1-4731-9ebe-938a94e2cb80 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:00.885987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:00.924604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51c054-6827-471e-a99d-2ad0b09e8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:00.925449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c054-6827-471e-a99d-2ad0b09e8d7a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.925844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c054-6827-471e-a99d-2ad0b09e8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.926216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c054-6827-471e-a99d-2ad0b09e8d7a None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.927064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51c054-6827-471e-a99d-2ad0b09e8d7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:00.927754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51c054-6827-471e-a99d-2ad0b09e8d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:00.929292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51c054-6827-471e-a99d-2ad0b09e8d7a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:00.937907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 53/110] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:00.939014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb4c1-e66f-41f9-8f78-50667d4a3fb1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:00.939308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb4c1-e66f-41f9-8f78-50667d4a3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:00.939579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb4c1-e66f-41f9-8f78-50667d4a3fb1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:00.942324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 54/111] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:00.942324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cb4c1-e66f-41f9-8f78-50667d4a3fb1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.012203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49140825-ffc3-4379-babb-d9d11ee38aec None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.046343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba85614-946d-48e9-b1f3-db6d169a1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.047121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85614-946d-48e9-b1f3-db6d169a1e78 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.047400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85614-946d-48e9-b1f3-db6d169a1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.047676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85614-946d-48e9-b1f3-db6d169a1e78 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.048899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba85614-946d-48e9-b1f3-db6d169a1e78 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:01.050357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba85614-946d-48e9-b1f3-db6d169a1e78 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:01.052064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 58/112] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:00 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:01.053254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773efb2e-c21a-47a5-a17b-19f104459ff0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.053536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773efb2e-c21a-47a5-a17b-19f104459ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.053808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773efb2e-c21a-47a5-a17b-19f104459ff0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.055186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 59/113] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:01.055732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773efb2e-c21a-47a5-a17b-19f104459ff0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.072916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cb4c1-e66f-41f9-8f78-50667d4a3fb1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.080372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:01.107957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16925a3c-0737-42c6-b2ae-f077ecca44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.108619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a3c-0737-42c6-b2ae-f077ecca44bd None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.108929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a3c-0737-42c6-b2ae-f077ecca44bd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.109201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a3c-0737-42c6-b2ae-f077ecca44bd None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.110017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925a3c-0737-42c6-b2ae-f077ecca44bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:01.111600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16925a3c-0737-42c6-b2ae-f077ecca44bd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:01.121412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:01.149013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 55/114] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:51:00 2022] POST /identity/v3/projects => generated 302 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:01.149013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb3ff4-9bfb-41b7-9924-63d8fe9581f5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.149013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb3ff4-9bfb-41b7-9924-63d8fe9581f5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.149013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb3ff4-9bfb-41b7-9924-63d8fe9581f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.164470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6fdb3ff4-9bfb-41b7-9924-63d8fe9581f5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:01.165800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6fdb3ff4-9bfb-41b7-9924-63d8fe9581f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:01.184544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773efb2e-c21a-47a5-a17b-19f104459ff0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.226569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.227455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.227736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.228354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] PATH_INFO: `/v3/users/f3118ad2395a4a5ea5565be712f02917` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.229281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] RBAC: Authorizing `identity:get_user(user_id=f3118ad2395a4a5ea5565be712f02917)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:01.230856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:01.232822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 60/115] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:01 2022] GET /identity/v3/users/f3118ad2395a4a5ea5565be712f02917 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:01.233503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.243246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 56/116] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:01.244578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae2af-92a6-402e-9dbb-8287f6a09311 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.244904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae2af-92a6-402e-9dbb-8287f6a09311 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.245182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cae2af-92a6-402e-9dbb-8287f6a09311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.263361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a2cae2af-92a6-402e-9dbb-8287f6a09311 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:01.264925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a2cae2af-92a6-402e-9dbb-8287f6a09311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:01.344621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 57/117] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:01.346272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192beb-f829-47c7-9165-2802fd54e212 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.346559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192beb-f829-47c7-9165-2802fd54e212 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.346841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192beb-f829-47c7-9165-2802fd54e212 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.348125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 58/118] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:01.348842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f192beb-f829-47c7-9165-2802fd54e212 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.356777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:01.374148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdbc19-0f3c-4091-b920-a96ed6026a43 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.409243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:01.416071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.417865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.419556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.419839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.420741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] RBAC: Adding query filter params (role.id=26a2684e70634bea8eb3f6ef7eb3e58f, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=112a9f5ef83949819c2a66d10f5cd671) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:01.421053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:01.422543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:01.428433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 61/119] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:01 2022] GET /identity/v3/role_assignments?user.id=112a9f5ef83949819c2a66d10f5cd671&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=26a2684e70634bea8eb3f6ef7eb3e58f => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:01.429270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.484128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f192beb-f829-47c7-9165-2802fd54e212 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.540943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db282ff-1076-434a-af56-38744332e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.541792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db282ff-1076-434a-af56-38744332e36d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.542079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db282ff-1076-434a-af56-38744332e36d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.542357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db282ff-1076-434a-af56-38744332e36d None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.544013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db282ff-1076-434a-af56-38744332e36d None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:01.545545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db282ff-1076-434a-af56-38744332e36d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:01.547522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 59/120] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:01 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:01.548819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415321-0e2b-4333-9449-afd60da5cf79 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.549136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415321-0e2b-4333-9449-afd60da5cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.549416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415321-0e2b-4333-9449-afd60da5cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.567666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-13415321-0e2b-4333-9449-afd60da5cf79 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:01.568945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-13415321-0e2b-4333-9449-afd60da5cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:01.600090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f555-8a8a-4f5e-8e3c-1913ece47d9b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.644848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.645688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.645964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.646243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.651687 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 60/121] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:01.653059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415321-0e2b-4333-9449-afd60da5cf79 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.662001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:01.670243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:01.671277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:01.672380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 62/122] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:01.677532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.694208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:01.732248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:01.793050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b90f5-e83e-4aa0-84ef-a7d2e9b8f6c4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.804863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415321-0e2b-4333-9449-afd60da5cf79 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:01.838319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.839557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.841516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:01.841516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:01.841516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.841516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.842183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:01.843301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/f3118ad2395a4a5ea5565be712f02917/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:01.846537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] RBAC: Authorizing `identity:create_grant(project_id=4768ad428ad24ba3b987e77a8d5007ee, user_id=f3118ad2395a4a5ea5565be712f02917, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:01.848476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:01.853290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:01.861563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:01.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:01.863645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 61/123] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:01.864405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.870201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 63/124] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:01 2022] PUT /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/f3118ad2395a4a5ea5565be712f02917/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:01.871412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:01.977772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:02.000477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c813d6-bb6f-4218-9a53-c3a310c5981c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.042653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.043900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.044351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.044808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.045881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:02.046334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:02.048256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:02.058716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 64/125] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:02.064534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.170175 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43660687-925b-425f-abcc-55e26e69bbe5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.184376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:02.192097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f4c84-8334-4f8b-a195-1b89c7961fe0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.215010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.215831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.216114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.216388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.227670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:02.236188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:02.237300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:02.238351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 62/126] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:02.239211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.240013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.240862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.241332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.241769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.242705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:02.243383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:02.244997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:02.247203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:02.260122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 65/127] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:02.261820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.401717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197044d3-2ac6-4c2b-bc7a-cb688e3a528a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.445541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.446464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.446750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.447027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.448254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:02.448901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5fe56-6b77-4470-949a-8924de2b475d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.449789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:02.452677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 63/128] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:02.452677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.492272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:02.566121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c95e87-1ae7-48bf-9c27-4003af92cb58 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.569348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.570042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.570331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.570609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.571384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:02.571694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:02.573142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:02.591430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 66/129] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:02.592113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.604106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.605063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.605353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.605632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.607222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:02.608849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:02.610634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 64/130] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:02.611398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.710400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:02.726918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826756c6-4a50-4c1a-b7e0-bdff0492db09 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.729665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:02.765975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.766863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.767147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.767539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.768781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:02.770578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:02.771909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 65/131] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:02.772694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.811067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054006f-fdc4-40b6-8f95-14291ae97725 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.871592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.872481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.872798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:02.873076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] PATH_INFO: `/v3/projects/7536603886574e59a75f34716a6eb711` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:02.875234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] RBAC: Authorizing `identity:get_project(project_id=7536603886574e59a75f34716a6eb711)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:02.876843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:02.878616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 67/132] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/projects/7536603886574e59a75f34716a6eb711 => generated 312 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:02.879405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:02.933113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eca47d-bd07-4f38-8b87-a7855a5b8949 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:02.998681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:02.999481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:02.999769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:03.000048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:03.001377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:03.003089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:03.010586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae933bf1-13c0-498e-8679-e5cf4cbe530a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:03.013906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 66/133] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:03.014525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:03.037620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:03.049387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:03.051956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:03.052567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:03.053691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:03.056578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:03.058219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:03.061860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 68/134] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:02 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:03.063763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:03.101073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:03.219932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c90fec-bf2e-4a8d-b5df-ee2b74fce570 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:03.220471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819ce9b-f940-4d93-995e-1c3ae429380e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:03.255217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:03.256340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:03.256786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:03.257314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/e3a33f6fa8494faea3791a72c2203e54/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:03.259539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4768ad428ad24ba3b987e77a8d5007ee, user_id=e3a33f6fa8494faea3791a72c2203e54, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:03.261212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:03.279300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 69/135] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:03 2022] PUT /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/e3a33f6fa8494faea3791a72c2203e54/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:03.282442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:03.295739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6558ca8-ea4c-460e-89ec-0c6f25aec836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:03.296992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558ca8-ea4c-460e-89ec-0c6f25aec836 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:03.298397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558ca8-ea4c-460e-89ec-0c6f25aec836 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:03.298810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558ca8-ea4c-460e-89ec-0c6f25aec836 None admin] PATH_INFO: `/v3/projects/7536603886574e59a75f34716a6eb711/users/e3a33f6fa8494faea3791a72c2203e54/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:03.304600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6558ca8-ea4c-460e-89ec-0c6f25aec836 None admin] RBAC: Authorizing `identity:create_grant(project_id=7536603886574e59a75f34716a6eb711, user_id=e3a33f6fa8494faea3791a72c2203e54, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:03.308793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6558ca8-ea4c-460e-89ec-0c6f25aec836 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:03.331692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 67/136] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:03 2022] PUT /identity/v3/projects/7536603886574e59a75f34716a6eb711/users/e3a33f6fa8494faea3791a72c2203e54/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:03.427143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:03.511024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f664d-de6d-411c-8e1e-87357a9146f1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:03.571155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203e86d-7c4c-441f-86ab-bad613ef60c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:03.572099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203e86d-7c4c-441f-86ab-bad613ef60c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:03.572381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203e86d-7c4c-441f-86ab-bad613ef60c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:03.572672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203e86d-7c4c-441f-86ab-bad613ef60c9 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/e3a33f6fa8494faea3791a72c2203e54/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:03.578996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203e86d-7c4c-441f-86ab-bad613ef60c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4768ad428ad24ba3b987e77a8d5007ee, user_id=e3a33f6fa8494faea3791a72c2203e54, role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:03.580555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203e86d-7c4c-441f-86ab-bad613ef60c9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:03.602608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 70/137] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:03 2022] PUT /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/e3a33f6fa8494faea3791a72c2203e54/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:03.840949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc954fa6-2dab-457b-a2dd-824bf05e0638 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:03.840949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc954fa6-2dab-457b-a2dd-824bf05e0638 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:03.840949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc954fa6-2dab-457b-a2dd-824bf05e0638 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:03.840949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 68/138] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:03.846387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b1ad-e34a-42ab-9428-eb0c8cfba496 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:03.846794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b1ad-e34a-42ab-9428-eb0c8cfba496 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:03.846975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558b1ad-e34a-42ab-9428-eb0c8cfba496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:03.877757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a558b1ad-e34a-42ab-9428-eb0c8cfba496 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:03.879157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a558b1ad-e34a-42ab-9428-eb0c8cfba496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:03.962319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 71/139] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:03.986951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc954fa6-2dab-457b-a2dd-824bf05e0638 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:04.122893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:04.127814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc954fa6-2dab-457b-a2dd-824bf05e0638 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:04.174823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc294a-e2ed-4c68-9e81-19294d1aa4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:04.175638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc294a-e2ed-4c68-9e81-19294d1aa4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:04.175921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc294a-e2ed-4c68-9e81-19294d1aa4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:04.176198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc294a-e2ed-4c68-9e81-19294d1aa4a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:04.180068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc294a-e2ed-4c68-9e81-19294d1aa4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:04.181583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc294a-e2ed-4c68-9e81-19294d1aa4a5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:04.183357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 69/140] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:04.189041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b1ad-e34a-42ab-9428-eb0c8cfba496 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:04.252332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:04.315592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558b1ad-e34a-42ab-9428-eb0c8cfba496 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:04.351752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:04.352440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:04.352739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:04.353017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:04.353815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:04.355363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:04.355545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f45cd-5bc4-4ad6-9a3b-b865d28303ad None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:04.355827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f45cd-5bc4-4ad6-9a3b-b865d28303ad None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:04.356106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f45cd-5bc4-4ad6-9a3b-b865d28303ad None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:04.357529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 70/141] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:04.370058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961792d-104b-4464-abc3-0e56e697ac14 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:04.370338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961792d-104b-4464-abc3-0e56e697ac14 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:04.370716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961792d-104b-4464-abc3-0e56e697ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:04.384344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 72/142] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:04 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:04.409956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6961792d-104b-4464-abc3-0e56e697ac14 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:04.411191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6961792d-104b-4464-abc3-0e56e697ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:04.533700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 71/143] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:04.574306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:04.706834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:04.710282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963d7e1-5355-4fff-82f8-93a246225d29 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:04.765419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114c3e8-428c-4bab-aef1-f7b40288c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:04.766573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114c3e8-428c-4bab-aef1-f7b40288c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:04.767016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114c3e8-428c-4bab-aef1-f7b40288c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:04.767446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114c3e8-428c-4bab-aef1-f7b40288c9d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:04.779393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114c3e8-428c-4bab-aef1-f7b40288c9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8114c3e8-428c-4bab-aef1-f7b40288c9d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:04.787570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:04.788562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:04.789366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:04.791459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 73/144] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:04.797885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961792d-104b-4464-abc3-0e56e697ac14 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:04.885790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c160-b038-4250-8a41-27871219309a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:04.886783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c160-b038-4250-8a41-27871219309a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:04.887269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c160-b038-4250-8a41-27871219309a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:04.889121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 74/145] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:04.909028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8442-ee11-476f-9360-7c0c32fa6700 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:04.909624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8442-ee11-476f-9360-7c0c32fa6700 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:04.910098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8442-ee11-476f-9360-7c0c32fa6700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:04.941383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a29c8442-ee11-476f-9360-7c0c32fa6700 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:04.943046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a29c8442-ee11-476f-9360-7c0c32fa6700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:04.950036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:04.958057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961792d-104b-4464-abc3-0e56e697ac14 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:05.015213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:05.016252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:05.016952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:05.018304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:05.019985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:05.020660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:05.023281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:05.037273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 72/146] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:05.043905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:05.057001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 75/147] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:05.111550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c8442-ee11-476f-9360-7c0c32fa6700 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:05.198278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67ede9-5e2c-4ace-8440-5894ce525b2f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:05.250636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:05.251448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:05.251854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:05.252139 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] PATH_INFO: `/v3/users/112a9f5ef83949819c2a66d10f5cd671` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:05.253685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] RBAC: Authorizing `identity:get_user(user_id=112a9f5ef83949819c2a66d10f5cd671)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:05.255148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:05.262428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 73/148] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:05 2022] GET /identity/v3/users/112a9f5ef83949819c2a66d10f5cd671 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:05.266500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:05.306874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:05.322179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:05.324820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c8442-ee11-476f-9360-7c0c32fa6700 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:05.390424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:05.391233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:05.391516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:05.391793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:05.414649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:05.422879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:05.423780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:05.424533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:05.428333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 76/149] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:05.439902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:05.464997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c2ee-306e-4ec6-a0c1-d263db347fee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:05.542468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:05.544005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:05.544473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:05.544983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:05.547293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:05.549087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:05.551310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 74/150] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:05 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:05.556600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:05.579603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881f89e-c0d4-4fb9-94f4-71482748e69f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:05.642993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:05.642993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:05.642993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:05.642993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:05.643435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:05.643829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:05.645413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:05.659042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 77/151] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:05.666364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:05.693007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:05.694614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:05.703510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb89d-eb37-4e62-babe-dbe0d90b1df1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:05.796805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b446a-f363-41c8-8e17-9931fcbe0408 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:05.799354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:05.800485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:05.801001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:05.801476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/112a9f5ef83949819c2a66d10f5cd671/roles/26a2684e70634bea8eb3f6ef7eb3e58f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:05.807511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] RBAC: Authorizing `identity:create_grant(project_id=4768ad428ad24ba3b987e77a8d5007ee, user_id=112a9f5ef83949819c2a66d10f5cd671, role_id=26a2684e70634bea8eb3f6ef7eb3e58f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:05.809658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:05.831977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:05.832921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:05.833270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:05.833548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] PATH_INFO: `/v3/users/f3118ad2395a4a5ea5565be712f02917` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:05.835188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] RBAC: Authorizing `identity:get_user(user_id=f3118ad2395a4a5ea5565be712f02917)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:05.837413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:05.838097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 78/152] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:05 2022] GET /identity/v3/users/f3118ad2395a4a5ea5565be712f02917 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:05.843984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:05.848731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 75/153] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:05 2022] PUT /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/users/112a9f5ef83949819c2a66d10f5cd671/roles/26a2684e70634bea8eb3f6ef7eb3e58f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:05.945869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:05.963567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55443d67-1e9b-494d-8808-c61d2668c15f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:06.000321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:06.001017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:06.001296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:06.001564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:06.075433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:06.076962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:06.161818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:06.184375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 79/154] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:06.189978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:06.332565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebecd-de57-4511-b0b9-46e4fec50024 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:06.373957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4b93b-6354-4cb8-a593-096cb36f6d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:06.374834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b93b-6354-4cb8-a593-096cb36f6d4f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:06.375117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b93b-6354-4cb8-a593-096cb36f6d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:06.375391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b93b-6354-4cb8-a593-096cb36f6d4f None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:06.378205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4b93b-6354-4cb8-a593-096cb36f6d4f None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:06.379738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4b93b-6354-4cb8-a593-096cb36f6d4f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:06.381587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 76/155] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:06 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:06.387767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:06.505086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e3edb-bb62-43e5-9646-9d08b51bf0fa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:06.541922 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d1b9-310d-48d7-bad4-1febafe195b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:06.544396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d1b9-310d-48d7-bad4-1febafe195b8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:06.544396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d1b9-310d-48d7-bad4-1febafe195b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:06.544396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d1b9-310d-48d7-bad4-1febafe195b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:06.544396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d1b9-310d-48d7-bad4-1febafe195b8 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=f3118ad2395a4a5ea5565be712f02917) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:06.544713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d1b9-310d-48d7-bad4-1febafe195b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:06.546164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d1b9-310d-48d7-bad4-1febafe195b8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:06.553193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 80/156] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:06 2022] GET /identity/v3/role_assignments?user.id=f3118ad2395a4a5ea5565be712f02917&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:06.873852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3e8e6-2c95-4803-bf24-b749211bc360 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:06.874278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3e8e6-2c95-4803-bf24-b749211bc360 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:06.874445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3e8e6-2c95-4803-bf24-b749211bc360 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:06.876275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 77/157] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:06.882263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc05e4-eb60-482d-82a6-822f309d73bb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:06.882585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc05e4-eb60-482d-82a6-822f309d73bb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:06.882818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc05e4-eb60-482d-82a6-822f309d73bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:06.903260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b6cc05e4-eb60-482d-82a6-822f309d73bb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:06.904454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b6cc05e4-eb60-482d-82a6-822f309d73bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:06.956022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:06.992562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 81/158] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:07.027237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3e8e6-2c95-4803-bf24-b749211bc360 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:07.055795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:07.145774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3e8e6-2c95-4803-bf24-b749211bc360 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:07.188923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982dd1-b9bf-491b-a382-a964a8ed11c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:07.189726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982dd1-b9bf-491b-a382-a964a8ed11c4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.190001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982dd1-b9bf-491b-a382-a964a8ed11c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.190523 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982dd1-b9bf-491b-a382-a964a8ed11c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.206708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93982dd1-b9bf-491b-a382-a964a8ed11c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-93982dd1-b9bf-491b-a382-a964a8ed11c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:07.214738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:07.215609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:07.216360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 78/159] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:07.223397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc05e4-eb60-482d-82a6-822f309d73bb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:07.242474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286cd7-9d36-4fcb-8a02-e793203d0232 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.242771 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286cd7-9d36-4fcb-8a02-e793203d0232 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.243032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286cd7-9d36-4fcb-8a02-e793203d0232 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.244657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 79/160] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:07.251216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523e5f2-431e-4941-9eeb-444b596feec4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.251498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523e5f2-431e-4941-9eeb-444b596feec4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.251771 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523e5f2-431e-4941-9eeb-444b596feec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.278589 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b523e5f2-431e-4941-9eeb-444b596feec4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:07.279834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b523e5f2-431e-4941-9eeb-444b596feec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:07.354172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc05e4-eb60-482d-82a6-822f309d73bb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:07.388181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6abc11-0d86-4be4-bb0b-865965ea5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:07.388881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6abc11-0d86-4be4-bb0b-865965ea5f85 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.389157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6abc11-0d86-4be4-bb0b-865965ea5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.389427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6abc11-0d86-4be4-bb0b-865965ea5f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.390179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6abc11-0d86-4be4-bb0b-865965ea5f85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:07.390480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6abc11-0d86-4be4-bb0b-865965ea5f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:07.391887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6abc11-0d86-4be4-bb0b-865965ea5f85 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:07.401142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 82/161] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:07.402422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0bc6-5241-4a03-a6c5-fad4d136aa17 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.402702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0bc6-5241-4a03-a6c5-fad4d136aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.402971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0bc6-5241-4a03-a6c5-fad4d136aa17 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.404320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 83/162] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:07.407910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0bc6-5241-4a03-a6c5-fad4d136aa17 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:07.432821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 80/163] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 11:51:07.434195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc852fff-7a53-4b81-8435-552a0cfdd80a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.434476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc852fff-7a53-4b81-8435-552a0cfdd80a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.434743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc852fff-7a53-4b81-8435-552a0cfdd80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.469842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bc852fff-7a53-4b81-8435-552a0cfdd80a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:07.471025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bc852fff-7a53-4b81-8435-552a0cfdd80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:07.479077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:07.494233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:07.581074 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0bc6-5241-4a03-a6c5-fad4d136aa17 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:07.615916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:07.616826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.617106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.617373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.618609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:07.619230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 81/164] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:07.620189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:07.620604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc852fff-7a53-4b81-8435-552a0cfdd80a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:07.622078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 84/165] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:07 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:07.629029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:07.737339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabb105-f130-463f-81e3-061a5e00325c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:07.749007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:07.783828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc852fff-7a53-4b81-8435-552a0cfdd80a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:07.805374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:07.806355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.806851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.807313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.826370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:07.827184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:07.827465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:07.827734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:07.849207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:07.865539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:07.866442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:07.867427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 82/166] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:07.868065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:07.880901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:07.947572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:07.949113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:07.993040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d119-54d0-4914-9bd6-3582e998c312 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:08.032868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:08.033935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:08.034220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:08.034500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:08.048210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:08.058234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:08.059119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:08.059898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:08.060486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 83/167] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:08.065045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:08.116574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 85/168] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:08.117729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:08.132988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:08.137140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:08.195262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516944f9-94e4-4fc8-afd1-9c58731f7610 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:08.256413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:08.257179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:08.257457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:08.257726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:08.258488 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:08.258790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:08.260490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:08.273611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 84/169] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:08.274627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:08.381684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333282e-d151-4c8f-8fe4-efdb91960af5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:08.400479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44b1b5-ea89-4c97-a168-f61682cdc7f8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:08.443831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:08.450372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:08.452394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:08.453791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:08.454131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] PATH_INFO: `/v3/projects/7536603886574e59a75f34716a6eb711` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:08.456782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] RBAC: Authorizing `identity:get_project(project_id=7536603886574e59a75f34716a6eb711)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:08.460102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:08.465672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 85/170] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/projects/7536603886574e59a75f34716a6eb711 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:08.466637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:08.477642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:08.478328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:08.478602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:08.478871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:08.479665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:08.479974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:08.481492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:08.516854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 86/171] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:08.517747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:08.628863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed46bd-7e18-48d7-be8d-5a740dfa7476 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:08.636917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:08.665810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:08.667018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:08.667463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:08.667981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:08.669778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:08.671465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:08.673300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 86/172] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:08.674360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:08.710694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c83c2-e5e6-46ae-8b8b-ecc9ff82ea7a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:08.788213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:08.789213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:08.789673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:08.790113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:08.791149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=7536603886574e59a75f34716a6eb711, user.id=e3a33f6fa8494faea3791a72c2203e54) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:08.792909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:08.794973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:08.810916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 87/173] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/role_assignments?user.id=e3a33f6fa8494faea3791a72c2203e54&scope.project.id=7536603886574e59a75f34716a6eb711&role.id=36180a439e5845b8b09129d2ba66c697 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:08.814932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:08.815647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:08.894437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb1605-754a-414c-b48b-85221769fdd7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:08.952380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:08.953525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:08.953813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:08.954086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] PATH_INFO: `/v3/users/e3a33f6fa8494faea3791a72c2203e54` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:08.955602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a33f6fa8494faea3791a72c2203e54)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:08.957137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:08.959389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 87/174] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/users/e3a33f6fa8494faea3791a72c2203e54 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:08.965279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:09.128470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed60da-08a9-4d13-9462-7a3a6084f8fc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:09.141907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab490ba4-ca6b-4902-8275-d1f040e02710 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:09.186537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:09.195630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:09.197681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5809030-6fc5-4a57-9613-46a9150eeb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:09.198476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5809030-6fc5-4a57-9613-46a9150eeb67 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.198748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5809030-6fc5-4a57-9613-46a9150eeb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.199018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5809030-6fc5-4a57-9613-46a9150eeb67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.199502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40274f2-2b89-4c18-9600-8375a7c3edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:09.200281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40274f2-2b89-4c18-9600-8375a7c3edaf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.200736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40274f2-2b89-4c18-9600-8375a7c3edaf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.201141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40274f2-2b89-4c18-9600-8375a7c3edaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.289403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40274f2-2b89-4c18-9600-8375a7c3edaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:09.291503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40274f2-2b89-4c18-9600-8375a7c3edaf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:09.321594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5809030-6fc5-4a57-9613-46a9150eeb67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:09.323210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5809030-6fc5-4a57-9613-46a9150eeb67 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:09.431995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 88/175] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:09.433478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad9b1-ecbb-4762-947a-be72c71f7315 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.433766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad9b1-ecbb-4762-947a-be72c71f7315 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.434036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad9b1-ecbb-4762-947a-be72c71f7315 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.437611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 89/176] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:09.438909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad9b1-ecbb-4762-947a-be72c71f7315 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:09.480226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 88/177] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:09.483686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800cec-ef6c-45e5-8d1d-3f34023f0863 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.484134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800cec-ef6c-45e5-8d1d-3f34023f0863 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.484547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800cec-ef6c-45e5-8d1d-3f34023f0863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.493628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:09.525762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-79800cec-ef6c-45e5-8d1d-3f34023f0863 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:09.527273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79800cec-ef6c-45e5-8d1d-3f34023f0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:09.575468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:09.607280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad9b1-ecbb-4762-947a-be72c71f7315 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:09.651163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 89/178] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:09.653328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79800cec-ef6c-45e5-8d1d-3f34023f0863 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:09.677567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:09.679479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.680162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.680921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.683507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:09.688607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:09.694012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 90/179] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:09 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:09.694851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:09.800810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79800cec-ef6c-45e5-8d1d-3f34023f0863 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:09.816948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:09.822694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ef522-6f8b-4e8e-ad41-06397b42383a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:09.846321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b4141-8ec5-4980-a069-18f940ddb81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:09.847196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4141-8ec5-4980-a069-18f940ddb81f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.847472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4141-8ec5-4980-a069-18f940ddb81f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.848262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4141-8ec5-4980-a069-18f940ddb81f None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.849767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b4141-8ec5-4980-a069-18f940ddb81f None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:09.851891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b4141-8ec5-4980-a069-18f940ddb81f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:09.854712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 90/180] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:09 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:09.856030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c692d-4375-4321-ba36-2a8d5766e512 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.856315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c692d-4375-4321-ba36-2a8d5766e512 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.856588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c692d-4375-4321-ba36-2a8d5766e512 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.862176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 91/181] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:09.862176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c692d-4375-4321-ba36-2a8d5766e512 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:09.866370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff3ae4-2283-4c05-8194-eb17110e6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:09.867164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3ae4-2283-4c05-8194-eb17110e6aae None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.867436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3ae4-2283-4c05-8194-eb17110e6aae None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.867703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff3ae4-2283-4c05-8194-eb17110e6aae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.878641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff3ae4-2283-4c05-8194-eb17110e6aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-72ff3ae4-2283-4c05-8194-eb17110e6aae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:09.886270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:09.887125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 91/182] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:09.891785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12ccc-5e78-444c-a85c-1550c98bc24c None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:09.892482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12ccc-5e78-444c-a85c-1550c98bc24c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:09.892482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12ccc-5e78-444c-a85c-1550c98bc24c None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:09.892482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 92/183] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:09.892482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12ccc-5e78-444c-a85c-1550c98bc24c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:09.896737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:09.976271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c692d-4375-4321-ba36-2a8d5766e512 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.002947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12ccc-5e78-444c-a85c-1550c98bc24c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.008813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbde7f0-a7ab-4492-b321-b08e5f27fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.009470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbde7f0-a7ab-4492-b321-b08e5f27fc22 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.009748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbde7f0-a7ab-4492-b321-b08e5f27fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.010012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbde7f0-a7ab-4492-b321-b08e5f27fc22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.010873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbde7f0-a7ab-4492-b321-b08e5f27fc22 None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=e3a33f6fa8494faea3791a72c2203e54) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:10.011178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbde7f0-a7ab-4492-b321-b08e5f27fc22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:10.012618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbde7f0-a7ab-4492-b321-b08e5f27fc22 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:10.018495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 92/184] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:09 2022] GET /identity/v3/role_assignments?user.id=e3a33f6fa8494faea3791a72c2203e54&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=36180a439e5845b8b09129d2ba66c697 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:10.019646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb66b2-1e0b-482e-8dc8-de4aa3f9142b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.019923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb66b2-1e0b-482e-8dc8-de4aa3f9142b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.020192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb66b2-1e0b-482e-8dc8-de4aa3f9142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.038134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6ffb66b2-1e0b-482e-8dc8-de4aa3f9142b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:10.039307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6ffb66b2-1e0b-482e-8dc8-de4aa3f9142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:10.040162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.040911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.041193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.041582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.042367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] RBAC: Adding query filter params (role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=e3a33f6fa8494faea3791a72c2203e54) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:10.043849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:10.044510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:10.060095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 93/185] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:09 2022] GET /identity/v3/role_assignments?user.id=e3a33f6fa8494faea3791a72c2203e54&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:10.060095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.101802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.129536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 93/186] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:10.130734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d7a2-5d13-4ae7-a69f-ca9cd84ac8cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.131051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d7a2-5d13-4ae7-a69f-ca9cd84ac8cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.131288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d7a2-5d13-4ae7-a69f-ca9cd84ac8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.162919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7a23d7a2-5d13-4ae7-a69f-ca9cd84ac8cd None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:10.164334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a23d7a2-5d13-4ae7-a69f-ca9cd84ac8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:10.185761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.227284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e606d-3739-43a9-8183-ace14b666458 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.253374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 94/187] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:10.262378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735780a2-1aa3-453a-9c6a-304613ef8a27 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.262684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735780a2-1aa3-453a-9c6a-304613ef8a27 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.262921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735780a2-1aa3-453a-9c6a-304613ef8a27 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.264525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 95/188] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:10.265296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735780a2-1aa3-453a-9c6a-304613ef8a27 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.280364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41ef8a-77dd-4d91-9349-d7980b24c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.281089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ef8a-77dd-4d91-9349-d7980b24c86e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.281371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ef8a-77dd-4d91-9349-d7980b24c86e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.281642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ef8a-77dd-4d91-9349-d7980b24c86e None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.282399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41ef8a-77dd-4d91-9349-d7980b24c86e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:10.282727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41ef8a-77dd-4d91-9349-d7980b24c86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:10.284095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41ef8a-77dd-4d91-9349-d7980b24c86e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:10.298108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 94/189] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:10.299611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b947-eef7-40e4-b87a-7fc9a31cef5f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.299898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b947-eef7-40e4-b87a-7fc9a31cef5f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.300174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b947-eef7-40e4-b87a-7fc9a31cef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.323036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2c20b947-eef7-40e4-b87a-7fc9a31cef5f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:10.324674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2c20b947-eef7-40e4-b87a-7fc9a31cef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:10.384244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735780a2-1aa3-453a-9c6a-304613ef8a27 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.399677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 95/190] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:10.402318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b947-eef7-40e4-b87a-7fc9a31cef5f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.417720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.418572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.419609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.419987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.420077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.430397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:10.438041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:10.438923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:10.439692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 96/191] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:10.440336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.454450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.509783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b947-eef7-40e4-b87a-7fc9a31cef5f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.541793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d45624-f896-4258-96ae-a016ce051e74 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.543464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.544285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.544554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.544847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.546031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:10.547472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:10.549094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 96/192] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:10.549841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.576374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.577287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.577567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.577838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] PATH_INFO: `/v3/users/75a9edd9122d4d769c71c3df7a353b88` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.591952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=75a9edd9122d4d769c71c3df7a353b88)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:10.593467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:10.599685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 97/193] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/users/75a9edd9122d4d769c71c3df7a353b88 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:10.599685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.633573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.650940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fbc48-8e65-4379-984d-27416ffc7916 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.663120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.684057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.684901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.685181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.685444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.694159 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec0c07-d07f-4c7b-981f-4a352420e0f5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.695593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:10.703625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:10.704492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:10.705293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 97/194] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:10.705943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.733158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.733936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.734221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.734493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.735272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:10.735553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:10.737087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:10.749743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 98/195] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:10.749743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.813779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8eff-b549-4177-a5a8-f6c7b8a50f50 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.847814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dedd27-0863-447b-baa4-adb15c44c6dd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:10.848079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.848784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.849058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.849338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.850062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:10.851521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:10.866956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.874118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 98/196] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:10 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:10.875058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:10.889112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:10.898425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:10.899285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:10.899723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:10.900247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:10.998253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.002011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.015859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37ec40-f512-4b40-a8ab-7f7ccbe0b347 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:11.055398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:11.056270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:11.056632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:11.057065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:11.057934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:11.058311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.059779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.075246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 99/197] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:11.075246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.135232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 99/198] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:11.136793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.139056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:11.175171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:11.201274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f8755-8989-4c33-aadd-5c29ec849d71 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:11.245360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:11.246255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:11.246707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:11.246991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] PATH_INFO: `/v3/users/112a9f5ef83949819c2a66d10f5cd671` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:11.248576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] RBAC: Authorizing `identity:get_user(user_id=112a9f5ef83949819c2a66d10f5cd671)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.250100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.252553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 100/199] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/users/112a9f5ef83949819c2a66d10f5cd671 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:11.253432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.271330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e233e9-2753-4dd3-ba53-a86801470292 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:11.311104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:11.312126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:11.312540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:11.312875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] PATH_INFO: `/v3/users/75a9edd9122d4d769c71c3df7a353b88` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:11.314156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] RBAC: Authorizing `identity:get_user(user_id=75a9edd9122d4d769c71c3df7a353b88)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.321067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.321911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 100/200] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/users/75a9edd9122d4d769c71c3df7a353b88 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:11.322855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.386301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff149b-d708-4834-a1c7-97a82de8d144 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:11.423480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:11.434643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:11.435770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:11.436228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:11.436675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:11.438080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.439829 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.442411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 101/201] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:11.443402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.476973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:11.482633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7dfca-ffdf-4ca3-8015-2fe333b817e6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:11.543478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:11.544626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:11.545149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:11.545611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:11.601586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d384d97-f920-46e7-a17f-cb342d7e1d58 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:11.637992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.639825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.649040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:11.649800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:11.649800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:11.651638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:11.748026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:11.758456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.760182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.762042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:11.766323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 101/202] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:11.767663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.877179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b98f96-2073-4786-9c96-3ca3734ec946 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:11.887930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 102/203] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:11.889318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.922989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:11.923755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:11.924200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:11.924473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:11.926346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=542addf9918145cbb654e539109817bf, user.id=75a9edd9122d4d769c71c3df7a353b88) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:11.926659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:11.928127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:11.935301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 102/204] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/role_assignments?user.id=75a9edd9122d4d769c71c3df7a353b88&scope.project.id=542addf9918145cbb654e539109817bf&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:11.936374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:11.991574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:11.999474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b922ec0-17e5-4dad-b1cb-5ad54d30d974 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:12.012080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:12.037542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:12.038835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:12.039310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:12.039776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:12.041353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:12.043554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:12.045928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 103/205] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:12.053317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3818337-4177-496a-9a35-b291a04ee730 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:12.054659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:12.089346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:12.090212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:12.090488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:12.090755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:12.092028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:12.093546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:12.095240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 103/206] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:11 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:12.101288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:12.175125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccbfb1-c508-48cf-aa51-0471ec3fb939 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:12.209359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a3f40-4e0d-497c-b6e5-c4579c85e969 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:12.242426 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:12.248125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d4672-eb01-456a-916b-31e3e5b7da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:12.248830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4672-eb01-456a-916b-31e3e5b7da41 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:12.249110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4672-eb01-456a-916b-31e3e5b7da41 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:12.249383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4672-eb01-456a-916b-31e3e5b7da41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:12.250225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d4672-eb01-456a-916b-31e3e5b7da41 None admin] RBAC: Adding query filter params (role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=542addf9918145cbb654e539109817bf, user.id=75a9edd9122d4d769c71c3df7a353b88) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:12.250530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d4672-eb01-456a-916b-31e3e5b7da41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:12.251981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d4672-eb01-456a-916b-31e3e5b7da41 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:12.261231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9793-f8df-4084-acd0-958cac3dad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:12.261913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9793-f8df-4084-acd0-958cac3dad75 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:12.262192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9793-f8df-4084-acd0-958cac3dad75 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:12.262463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9793-f8df-4084-acd0-958cac3dad75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:12.263329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9793-f8df-4084-acd0-958cac3dad75 None admin] RBAC: Adding query filter params (role.id=26a2684e70634bea8eb3f6ef7eb3e58f, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee, user.id=112a9f5ef83949819c2a66d10f5cd671) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:12.263640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9793-f8df-4084-acd0-958cac3dad75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:12.265098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 104/207] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:12 2022] GET /identity/v3/role_assignments?user.id=75a9edd9122d4d769c71c3df7a353b88&scope.project.id=542addf9918145cbb654e539109817bf&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:12.265220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9793-f8df-4084-acd0-958cac3dad75 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:12.276011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 104/208] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:12 2022] GET /identity/v3/role_assignments?user.id=112a9f5ef83949819c2a66d10f5cd671&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=26a2684e70634bea8eb3f6ef7eb3e58f => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:13.402363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc772-9b1f-4cb4-aa11-e06f8e64b618 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.402884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc772-9b1f-4cb4-aa11-e06f8e64b618 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.402884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc772-9b1f-4cb4-aa11-e06f8e64b618 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.404431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 105/209] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:13.410017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751ea7-739a-4b25-b75f-8aba40573940 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.410426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751ea7-739a-4b25-b75f-8aba40573940 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.410599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751ea7-739a-4b25-b75f-8aba40573940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.413088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3324e-cd01-4631-932f-ead062906ef3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.413368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3324e-cd01-4631-932f-ead062906ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.413645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3324e-cd01-4631-932f-ead062906ef3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.414938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 106/210] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:13.420352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a8736-2cd0-4a95-a639-1413fdf258e7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.420648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a8736-2cd0-4a95-a639-1413fdf258e7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.420930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a8736-2cd0-4a95-a639-1413fdf258e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.428216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c7751ea7-739a-4b25-b75f-8aba40573940 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:13.429457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c7751ea7-739a-4b25-b75f-8aba40573940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:13.438394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-556a8736-2cd0-4a95-a639-1413fdf258e7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:13.439560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-556a8736-2cd0-4a95-a639-1413fdf258e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:13.454913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:13.532671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 105/211] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:13.537178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 107/212] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:13.553294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751ea7-739a-4b25-b75f-8aba40573940 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:13.563497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a8736-2cd0-4a95-a639-1413fdf258e7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:13.673610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751ea7-739a-4b25-b75f-8aba40573940 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:13.683574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a8736-2cd0-4a95-a639-1413fdf258e7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:13.714927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:13.716982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:13.718219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.718499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.718768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.726362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:13.727747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.728203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.728670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.730156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:13.730487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:13.732116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:13.733964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 108/213] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:13.738724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:13.739612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:13.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 106/214] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:13.741715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:13.747545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:13.777133 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:13.855184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd06927-3e74-4cd5-8ed6-5853ab495beb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:13.864784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c23047-04b1-41f8-a214-2adb5f5c7083 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:13.892119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:13.892929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.893214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.893489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.894367 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:13.895761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:13.902373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:13.903335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:13.903891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:13.904423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:13.905626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:13.906159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:13.907865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:13.918578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 107/215] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:13.921808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 109/216] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:13 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:13.929960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:14.024923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:14.054137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8b53e-6697-43df-9beb-7e1f6fd24b2c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:14.094004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:14.095297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.095801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.096278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] PATH_INFO: `/v3/users/b694334693284efda8838d328c3f8f75` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.113314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] RBAC: Authorizing `identity:get_user(user_id=b694334693284efda8838d328c3f8f75)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:14.115221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:14.117526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 108/217] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:13 2022] GET /identity/v3/users/b694334693284efda8838d328c3f8f75 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:14.126389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:14.180964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:14.237192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed737e-45b5-41f2-b8c9-d33ae679653a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:14.273671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000045a3-61b1-45c4-9c99-7b048bccea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:14.274796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000045a3-61b1-45c4-9c99-7b048bccea4b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.275276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000045a3-61b1-45c4-9c99-7b048bccea4b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.275742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000045a3-61b1-45c4-9c99-7b048bccea4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.353534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000045a3-61b1-45c4-9c99-7b048bccea4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:14.355282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000045a3-61b1-45c4-9c99-7b048bccea4b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:14.404811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:14.463571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 110/218] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:14.469789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:14.487865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3585c-b252-484f-9af3-5825ad78689f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.488165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3585c-b252-484f-9af3-5825ad78689f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.488422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3585c-b252-484f-9af3-5825ad78689f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.489841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 111/219] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:14.495003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f9f5-df35-4929-b075-3a52cc4cdce9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.495293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f9f5-df35-4929-b075-3a52cc4cdce9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.495576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f9f5-df35-4929-b075-3a52cc4cdce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.512918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-da28f9f5-df35-4929-b075-3a52cc4cdce9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:14.514146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da28f9f5-df35-4929-b075-3a52cc4cdce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:14.583649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 112/220] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:14.605636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f9f5-df35-4929-b075-3a52cc4cdce9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:14.643835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbfdf6-a102-4fd6-94ca-3238a2f16eee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:14.679633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941aa181-a4b3-4178-abae-28503ce37c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:14.680618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa181-a4b3-4178-abae-28503ce37c06 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.680978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa181-a4b3-4178-abae-28503ce37c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.681334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa181-a4b3-4178-abae-28503ce37c06 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.682590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941aa181-a4b3-4178-abae-28503ce37c06 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:14.684051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941aa181-a4b3-4178-abae-28503ce37c06 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:14.685847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 109/221] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:14 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:14.687157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77daac0-92ae-485d-a623-9afa8f279267 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.687472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77daac0-92ae-485d-a623-9afa8f279267 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.687762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77daac0-92ae-485d-a623-9afa8f279267 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.693345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:14.694859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 110/222] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:14.696069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77daac0-92ae-485d-a623-9afa8f279267 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:14.708945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:14.722854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f9f5-df35-4929-b075-3a52cc4cdce9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:14.758746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ff79d-8576-461d-97e7-31386f16b118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:14.759844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ff79d-8576-461d-97e7-31386f16b118 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.760303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ff79d-8576-461d-97e7-31386f16b118 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.760794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ff79d-8576-461d-97e7-31386f16b118 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.772147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ff79d-8576-461d-97e7-31386f16b118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e79ff79d-8576-461d-97e7-31386f16b118 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:14.780069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:14.781174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:14.782096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:14.784443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 113/223] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:14.785809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a2a7-069f-4857-a1fb-63445ff64779 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.786210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a2a7-069f-4857-a1fb-63445ff64779 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.786599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a2a7-069f-4857-a1fb-63445ff64779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.808159 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a300a2a7-069f-4857-a1fb-63445ff64779 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:14.809670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a300a2a7-069f-4857-a1fb-63445ff64779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:14.856150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77daac0-92ae-485d-a623-9afa8f279267 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:14.879864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 114/224] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:14.886214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a2a7-069f-4857-a1fb-63445ff64779 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:14.912897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:14.913625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:14.913909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:14.914188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:14.915037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=542addf9918145cbb654e539109817bf, user.id=b694334693284efda8838d328c3f8f75) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:14.915349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:14.917007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:14.924045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 111/225] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:14 2022] GET /identity/v3/role_assignments?user.id=b694334693284efda8838d328c3f8f75&scope.project.id=542addf9918145cbb654e539109817bf&role.id=36180a439e5845b8b09129d2ba66c697 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:14.929163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:14.977916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:15.017021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a2a7-069f-4857-a1fb-63445ff64779 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.059347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.060455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.060981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.061444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.062728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:15.063523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:15.065697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:15.076359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 115/226] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:15.085969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:15.089900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:15.157554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed14b7-3257-4d8f-81d9-15eb4805aabc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.226023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.226852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.227129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.227407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.239744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:15.248460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:15.250120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:15.251079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 112/227] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:15.263071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:15.285303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eeb70-11c7-4b6b-979b-c8ecba5c4871 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.320114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:15.336035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.336949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.337228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.339618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] PATH_INFO: `/v3/users/75a9edd9122d4d769c71c3df7a353b88` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.341653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] RBAC: Authorizing `identity:get_user(user_id=75a9edd9122d4d769c71c3df7a353b88)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:15.346131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:15.353057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 116/228] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:15 2022] GET /identity/v3/users/75a9edd9122d4d769c71c3df7a353b88 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:15.355070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:15.473816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cfc6e-8b0d-4860-97b2-962d69491ace None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.511480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:15.512746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.513492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.513804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.514293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.515111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:15.515447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:15.516940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:15.533127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 113/229] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:15.539461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:15.567517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c8b3-8221-4fda-9336-b1ce7f68ac03 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.636227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.637132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.637408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.637679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.640719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:15.642350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:15.644832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 117/230] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:15 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:15.650163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:15.699864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76232bdb-c8e0-46cf-891e-3c228d176eba None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.763407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.764213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.764491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.764790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] PATH_INFO: `/v3/users/75a9edd9122d4d769c71c3df7a353b88` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.766157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] RBAC: Authorizing `identity:get_user(user_id=75a9edd9122d4d769c71c3df7a353b88)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:15.767818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:15.769519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 114/231] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:15 2022] GET /identity/v3/users/75a9edd9122d4d769c71c3df7a353b88 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:15.775006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:15.786019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:15.853565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed6d47-e0f1-458f-8438-ca712e566015 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.874422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:15.929358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0037-71bc-465e-bc48-fb9527776140 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:15.931922 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.932908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.933191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.933466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf/users/75a9edd9122d4d769c71c3df7a353b88/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.936232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=542addf9918145cbb654e539109817bf, user_id=75a9edd9122d4d769c71c3df7a353b88, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:15.937727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:15.963192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 118/232] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:15 2022] PUT /identity/v3/projects/542addf9918145cbb654e539109817bf/users/75a9edd9122d4d769c71c3df7a353b88/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:51:15.995273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959fbc6-e596-4d02-bc39-cd220f3bf222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:15.996152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959fbc6-e596-4d02-bc39-cd220f3bf222 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:15.996432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959fbc6-e596-4d02-bc39-cd220f3bf222 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:15.996737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959fbc6-e596-4d02-bc39-cd220f3bf222 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:15.997944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959fbc6-e596-4d02-bc39-cd220f3bf222 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:15.999420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959fbc6-e596-4d02-bc39-cd220f3bf222 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:16.001651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 115/233] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:15 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:16.007295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:16.162079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8d4a2-4620-4ad9-8a4c-b994ae0a2fcf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:16.195824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:16.205150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8637d-24ef-4be2-891c-5406b7932d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:16.206397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8637d-24ef-4be2-891c-5406b7932d7d None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:16.206876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8637d-24ef-4be2-891c-5406b7932d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:16.207346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8637d-24ef-4be2-891c-5406b7932d7d None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf/users/75a9edd9122d4d769c71c3df7a353b88/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:16.209871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8637d-24ef-4be2-891c-5406b7932d7d None admin] RBAC: Authorizing `identity:create_grant(project_id=542addf9918145cbb654e539109817bf, user_id=75a9edd9122d4d769c71c3df7a353b88, role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:16.211642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8637d-24ef-4be2-891c-5406b7932d7d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:16.231733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 119/234] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:16 2022] PUT /identity/v3/projects/542addf9918145cbb654e539109817bf/users/75a9edd9122d4d769c71c3df7a353b88/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:16.640443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d829-18b4-4ada-a1fc-969ca647722b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:16.640971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d829-18b4-4ada-a1fc-969ca647722b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:16.641086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d829-18b4-4ada-a1fc-969ca647722b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:16.642604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 116/235] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:16.647666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ae1b-aff7-443d-b170-7e9e66602146 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:16.648060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ae1b-aff7-443d-b170-7e9e66602146 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:16.648224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ae1b-aff7-443d-b170-7e9e66602146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:16.670093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ed01ae1b-aff7-443d-b170-7e9e66602146 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:16.671273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ed01ae1b-aff7-443d-b170-7e9e66602146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:16.757230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 120/236] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:16.791615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0d829-18b4-4ada-a1fc-969ca647722b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:16.897379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9616dc-9a37-4ec1-be3d-c3febe032418 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:16.897705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9616dc-9a37-4ec1-be3d-c3febe032418 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:16.897925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9616dc-9a37-4ec1-be3d-c3febe032418 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:16.899303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 121/237] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:16.907713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92929f-8949-46f7-91cd-9efa8a5c28ac None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:16.907983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92929f-8949-46f7-91cd-9efa8a5c28ac None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:16.908257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92929f-8949-46f7-91cd-9efa8a5c28ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:16.933862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a92929f-8949-46f7-91cd-9efa8a5c28ac None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:16.935218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a92929f-8949-46f7-91cd-9efa8a5c28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:16.961973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0d829-18b4-4ada-a1fc-969ca647722b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:17.018160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 122/238] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:17.032491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:17.047986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92929f-8949-46f7-91cd-9efa8a5c28ac None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:17.051127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:17.051928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.052205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.052477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.085558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:17.093389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:17.094290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:17.095066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 117/239] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:17.103024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:17.112351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:17.207072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92929f-8949-46f7-91cd-9efa8a5c28ac None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:17.242617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4aa2-90fa-4414-be30-c05afd2593d2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:17.265495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:17.266349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.266626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.266939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.268110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:17.269841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:17.271993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 123/240] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:17.277747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:17.327732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:17.328418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.328723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.329059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.329823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:17.330128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:17.331535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:17.347673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 118/241] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:17.354022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:17.443609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:17.450847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b7c4-9fa3-4d11-880a-e77adac42fde None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:17.489172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:17.528401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41708fc3-a623-4d3c-a6ae-ee1042d7de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:17.529485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708fc3-a623-4d3c-a6ae-ee1042d7de05 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.531028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708fc3-a623-4d3c-a6ae-ee1042d7de05 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.531750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708fc3-a623-4d3c-a6ae-ee1042d7de05 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.533815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41708fc3-a623-4d3c-a6ae-ee1042d7de05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:17.536407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41708fc3-a623-4d3c-a6ae-ee1042d7de05 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:17.539718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d0a55-e038-45e7-b1a5-cfc17c0565c7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:17.577079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 124/242] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:17 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:17.579108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d095-9803-4dad-802e-a6824a2f5c34 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.579668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d095-9803-4dad-802e-a6824a2f5c34 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.580138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d095-9803-4dad-802e-a6824a2f5c34 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.583497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 125/243] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:17.592773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83a77-810c-4ce1-925d-72b08fb6e1a5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.592993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83a77-810c-4ce1-925d-72b08fb6e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.593252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b83a77-810c-4ce1-925d-72b08fb6e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.612310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:17.613786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.614341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.614819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] PATH_INFO: `/v3/users/d14b14f068bc47fa9b3ea0f5dad6ce53` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.615249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-24b83a77-810c-4ce1-925d-72b08fb6e1a5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:17.618952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24b83a77-810c-4ce1-925d-72b08fb6e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:17.670546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] RBAC: Authorizing `identity:get_user(user_id=d14b14f068bc47fa9b3ea0f5dad6ce53)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:17.671752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:17.673955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 119/244] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:17 2022] GET /identity/v3/users/d14b14f068bc47fa9b3ea0f5dad6ce53 => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:17.679497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:17.702656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 126/245] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:17.727223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83a77-810c-4ce1-925d-72b08fb6e1a5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:17.878425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaf393-8931-412f-94fd-fc5d37cbac14 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:17.882482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b83a77-810c-4ce1-925d-72b08fb6e1a5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:17.884008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:17.890762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:17.920794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:17.922490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.922490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.922490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.928484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:17.929495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:17.929915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:17.930352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:17.942959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:17.951583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:17.952631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:17.953441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:17.956065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 127/246] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:17.964201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:18.004086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:18.005761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:18.077355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efefc3-2a9c-4e04-ba2a-1476080fcabb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:18.111865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 120/247] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:18.114143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:18.115063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.115534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.116354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.117195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:18.117596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:18.118108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:18.119852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:18.128149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:18.130875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 128/248] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:18.141917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:18.170993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:18.242914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0b7d7-536f-45ee-888a-b7e6ae12c81b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:18.252775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df86af-bdc4-431f-8de6-fb300b521e19 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:18.279653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:18.280621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.280963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.281236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.282524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:18.284051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:18.286059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 121/249] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:18 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:18.291910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:18.293891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:18.295011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.295482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.295943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] PATH_INFO: `/v3/users/b694334693284efda8838d328c3f8f75` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.297449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] RBAC: Authorizing `identity:get_user(user_id=b694334693284efda8838d328c3f8f75)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:18.299116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:18.301029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 129/250] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:18 2022] GET /identity/v3/users/b694334693284efda8838d328c3f8f75 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:18.312460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:18.404623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:18.432892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82c1e-e2a9-4706-8a87-e2e3d0928bcc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:18.456556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:18.470708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1c032-62d4-492e-8803-b26e1b62f76a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:18.476042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:18.476997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.477476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.477958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.479086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] RBAC: Adding query filter params (role.id=26a2684e70634bea8eb3f6ef7eb3e58f, scope.project.id=542addf9918145cbb654e539109817bf, user.id=d14b14f068bc47fa9b3ea0f5dad6ce53) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:18.479670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:18.481443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:18.488632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 122/251] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:18 2022] GET /identity/v3/role_assignments?user.id=d14b14f068bc47fa9b3ea0f5dad6ce53&scope.project.id=542addf9918145cbb654e539109817bf&role.id=26a2684e70634bea8eb3f6ef7eb3e58f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:18.512871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e4e2e-8663-4450-9a4e-eac63d118408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:18.514203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e4e2e-8663-4450-9a4e-eac63d118408 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.514711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e4e2e-8663-4450-9a4e-eac63d118408 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.515189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e4e2e-8663-4450-9a4e-eac63d118408 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.516968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e4e2e-8663-4450-9a4e-eac63d118408 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:18.518880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e4e2e-8663-4450-9a4e-eac63d118408 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:18.521202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 130/252] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:18 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:18.528039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:18.655726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50749971-a920-433a-88c3-8abf7bc78f3c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:18.698205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a069b-c4c4-4ee5-9cc4-fbbf176bddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:18.699061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a069b-c4c4-4ee5-9cc4-fbbf176bddde None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.699342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a069b-c4c4-4ee5-9cc4-fbbf176bddde None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.699609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a069b-c4c4-4ee5-9cc4-fbbf176bddde None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf/users/b694334693284efda8838d328c3f8f75/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.706291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a069b-c4c4-4ee5-9cc4-fbbf176bddde None admin] RBAC: Authorizing `identity:create_grant(project_id=542addf9918145cbb654e539109817bf, user_id=b694334693284efda8838d328c3f8f75, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:18.707794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a069b-c4c4-4ee5-9cc4-fbbf176bddde None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:18.718665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:18.723335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 123/253] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:18 2022] PUT /identity/v3/projects/542addf9918145cbb654e539109817bf/users/b694334693284efda8838d328c3f8f75/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:18.764141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a20d3-3079-4761-bf4e-470c6d57fcb2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.764680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a20d3-3079-4761-bf4e-470c6d57fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.764789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a20d3-3079-4761-bf4e-470c6d57fcb2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.766368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 131/254] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:18.772212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ca53-90b2-421f-920c-a429b833e4aa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.772507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ca53-90b2-421f-920c-a429b833e4aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.772781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ca53-90b2-421f-920c-a429b833e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.791030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1d93ca53-90b2-421f-920c-a429b833e4aa None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:18.792289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1d93ca53-90b2-421f-920c-a429b833e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:18.810511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0a354-84cd-4bd8-a99b-d5a10d0f113c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.810820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0a354-84cd-4bd8-a99b-d5a10d0f113c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.811084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0a354-84cd-4bd8-a99b-d5a10d0f113c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.816951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 132/255] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:18.818410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efc0e-0ff8-4034-b1e0-bcbaf6383ada None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:18.818695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efc0e-0ff8-4034-b1e0-bcbaf6383ada None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:18.818971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efc0e-0ff8-4034-b1e0-bcbaf6383ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:18.857783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7c8efc0e-0ff8-4034-b1e0-bcbaf6383ada None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:18.859003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c8efc0e-0ff8-4034-b1e0-bcbaf6383ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:18.868396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 124/256] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:18.903907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93ca53-90b2-421f-920c-a429b833e4aa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:18.997108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 133/257] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:19.029745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efc0e-0ff8-4034-b1e0-bcbaf6383ada None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:19.053813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93ca53-90b2-421f-920c-a429b833e4aa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:19.100677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:19.100677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:19.100677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:19.100992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:19.101201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:19.123739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:19.131450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:19.132321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:19.133186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:19.134889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 125/258] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:19.143046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:19.208379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:19.218694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efc0e-0ff8-4034-b1e0-bcbaf6383ada None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:19.309620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c839-cdb1-4a34-a65a-91f73b839855 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:19.337950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:19.338818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:19.339093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:19.339360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:19.368176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:19.368874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:19.369161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:19.369464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:19.370260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:19.370565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:19.372000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:19.373271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:19.381641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 126/259] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:19.382146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:19.383014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:19.383852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:19.388903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 134/260] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:19.390657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:19.397626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:19.492191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:19.578846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9744ae0-1e6b-4146-ae69-a3159f592c39 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:19.632256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b6ccf-662a-4bc5-9b20-69d02e9195c4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:19.644157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:19.644863 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:19.645144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:19.645414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:19.646168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:19.646824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:19.648222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:19.663815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 135/261] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:19.669785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:19.693026 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:19.729491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:19.731359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:19.732021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:19.732918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] PATH_INFO: `/v3/users/75a9edd9122d4d769c71c3df7a353b88` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:19.736596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] RBAC: Authorizing `identity:get_user(user_id=75a9edd9122d4d769c71c3df7a353b88)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:19.738570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:19.742400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 127/262] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:19 2022] GET /identity/v3/users/75a9edd9122d4d769c71c3df7a353b88 => generated 283 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:19.749601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:19.871601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f21fab-103e-4d51-9dda-d41e5d8ef20f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:19.934259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d589-aabf-474e-9779-28409141bcbc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:19.950575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:19.951881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:19.952360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:19.952858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] PATH_INFO: `/v3/users/75a9edd9122d4d769c71c3df7a353b88` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:19.954646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] RBAC: Authorizing `identity:get_user(user_id=75a9edd9122d4d769c71c3df7a353b88)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:19.958680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:19.965691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 136/263] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:19 2022] GET /identity/v3/users/75a9edd9122d4d769c71c3df7a353b88 => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:19.970726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:19.976440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:20.005366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:20.006029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:20.006310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:20.006584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:20.086867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:20.088519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:20.173787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:20.203480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46e611-17f0-468a-92d8-084a40e1ecfd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:20.267609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:20.268618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:20.269106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:20.269910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:20.315887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 128/264] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:51:20.321331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:20.354171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:20.355975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:20.372999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:20.474867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:20.529773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 137/265] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:51:20.535051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:20.562674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b86d9-e528-44e5-940e-d6080aea3cf8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:20.619880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:20.620774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:20.621050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:20.621319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:20.624763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:20.626233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:20.627975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 129/266] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:20 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:20.639573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:20.742312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:20.753267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b1f29-3698-4241-a804-e35bbddbd299 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:20.756239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc6768-e81d-4e47-a464-c1058d99d3c6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:20.805342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:20.806395 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:20.806813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:20.807260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:20.808257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=542addf9918145cbb654e539109817bf, user.id=75a9edd9122d4d769c71c3df7a353b88) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:20.808723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:20.810453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:20.821727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 130/267] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:20 2022] GET /identity/v3/role_assignments?user.id=75a9edd9122d4d769c71c3df7a353b88&scope.project.id=542addf9918145cbb654e539109817bf&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:20.825421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81015f8a-06e2-414b-bab2-6e2a29f7815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:20.826428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81015f8a-06e2-414b-bab2-6e2a29f7815b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:20.826808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81015f8a-06e2-414b-bab2-6e2a29f7815b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:20.827180 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81015f8a-06e2-414b-bab2-6e2a29f7815b None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:20.830088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81015f8a-06e2-414b-bab2-6e2a29f7815b None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:20.831729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81015f8a-06e2-414b-bab2-6e2a29f7815b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:20.833730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 138/268] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:20 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:20.840402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:20.968255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b852e-e405-4c9e-a691-1f338871a412 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:21.004583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec19ac-d3a4-4dd4-b7f9-cf7091a30517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:21.005493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec19ac-d3a4-4dd4-b7f9-cf7091a30517 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.005910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec19ac-d3a4-4dd4-b7f9-cf7091a30517 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.006314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec19ac-d3a4-4dd4-b7f9-cf7091a30517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.007313 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec19ac-d3a4-4dd4-b7f9-cf7091a30517 None admin] RBAC: Adding query filter params (role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=542addf9918145cbb654e539109817bf, user.id=75a9edd9122d4d769c71c3df7a353b88) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:21.007755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec19ac-d3a4-4dd4-b7f9-cf7091a30517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:21.009478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec19ac-d3a4-4dd4-b7f9-cf7091a30517 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:21.016279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 131/269] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:20 2022] GET /identity/v3/role_assignments?user.id=75a9edd9122d4d769c71c3df7a353b88&scope.project.id=542addf9918145cbb654e539109817bf&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:21.404146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4394-b864-4b0f-a6a7-74f5caf731fe None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.404709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4394-b864-4b0f-a6a7-74f5caf731fe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.404709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4394-b864-4b0f-a6a7-74f5caf731fe None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.406101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 139/270] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:21.412604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507d57-3328-45f1-a567-ff922d0b025e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.413434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507d57-3328-45f1-a567-ff922d0b025e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.413948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507d57-3328-45f1-a567-ff922d0b025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.433877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4fb7-7066-4611-803c-0adbe9571fd2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.434487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4fb7-7066-4611-803c-0adbe9571fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.434893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6c507d57-3328-45f1-a567-ff922d0b025e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:21.435035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4fb7-7066-4611-803c-0adbe9571fd2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.436380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6c507d57-3328-45f1-a567-ff922d0b025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:21.436606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 140/271] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:21.445420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d450-9b7e-464a-b2a8-927b05d8d80e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.445850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d450-9b7e-464a-b2a8-927b05d8d80e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.446220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d450-9b7e-464a-b2a8-927b05d8d80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.453335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:21.467610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4454d450-9b7e-464a-b2a8-927b05d8d80e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:21.468821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4454d450-9b7e-464a-b2a8-927b05d8d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:21.536103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:21.542515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 132/272] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:21.563543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 141/273] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:21.584120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c507d57-3328-45f1-a567-ff922d0b025e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:21.588816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d450-9b7e-464a-b2a8-927b05d8d80e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:21.687946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c507d57-3328-45f1-a567-ff922d0b025e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:21.701066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d450-9b7e-464a-b2a8-927b05d8d80e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:21.722476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:21.723572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.724015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.724447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.725893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:21.727542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:21.729729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 133/274] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:21.735319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:21.737601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:21.738572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.738820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.739131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.750827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:21.752783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:21.760526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:21.761485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:21.762274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:21.765292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 142/275] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:21.771471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:21.820743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:21.854563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c148-f784-473a-8050-5b87e9f7db55 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:21.891044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:21.891711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.891985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.892251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.893063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:21.894638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:21.897011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebd19a-ad59-4cb3-8b85-0568b4c3d421 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:21.923964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 134/276] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:21 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:51:21.938511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ab341-5d35-458f-b4dc-9d7af4750631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:21.939526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab341-5d35-458f-b4dc-9d7af4750631 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.939981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab341-5d35-458f-b4dc-9d7af4750631 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.940445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab341-5d35-458f-b4dc-9d7af4750631 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:21.941463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab341-5d35-458f-b4dc-9d7af4750631 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:21.941955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab341-5d35-458f-b4dc-9d7af4750631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:21.943611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab341-5d35-458f-b4dc-9d7af4750631 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:21.959012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 143/277] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:21.961676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:21.998501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113eca5-1934-41d7-a399-b50dc4eb9987 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:21.999225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113eca5-1934-41d7-a399-b50dc4eb9987 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:21.999730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113eca5-1934-41d7-a399-b50dc4eb9987 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.001420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 144/278] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:22.008167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272fc4-800f-4bd7-8013-4b49e8643e6e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.008460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272fc4-800f-4bd7-8013-4b49e8643e6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.008766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272fc4-800f-4bd7-8013-4b49e8643e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.031315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bd272fc4-800f-4bd7-8013-4b49e8643e6e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:22.032540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bd272fc4-800f-4bd7-8013-4b49e8643e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:22.046191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:22.090513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081be7f4-2467-4498-a749-38840c86c742 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.114281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 145/279] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:22.115907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30428d37-e9fc-4492-ac5a-f7e1ed546adc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.116193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30428d37-e9fc-4492-ac5a-f7e1ed546adc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.116464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30428d37-e9fc-4492-ac5a-f7e1ed546adc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.117976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 146/280] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:22.123630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee27c9-60c5-46bf-8b83-bd00897ac892 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.123909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee27c9-60c5-46bf-8b83-bd00897ac892 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.124176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee27c9-60c5-46bf-8b83-bd00897ac892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.139231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.140176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.140460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.140766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] PATH_INFO: `/v3/users/d14b14f068bc47fa9b3ea0f5dad6ce53` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.142025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=d14b14f068bc47fa9b3ea0f5dad6ce53)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:22.142467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-21ee27c9-60c5-46bf-8b83-bd00897ac892 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:22.143492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:22.143646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21ee27c9-60c5-46bf-8b83-bd00897ac892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:22.145178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 135/281] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:21 2022] GET /identity/v3/users/d14b14f068bc47fa9b3ea0f5dad6ce53 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:22.145940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.177000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:22.238529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 147/282] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:22.239336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee27c9-60c5-46bf-8b83-bd00897ac892 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.273900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281ac8-3662-48b9-bbc5-eeb09cce6eb3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.317457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.317905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.318779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.318779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.327328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:22.332585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:22.341005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:22.341920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:22.342696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 136/283] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:22.343338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.375356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee27c9-60c5-46bf-8b83-bd00897ac892 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.424718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.425650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.425933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.426207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.428101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:22.429979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:22.432896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 148/284] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:22.434403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.450047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223ce0e-870e-4818-b5cd-8eb8ebde148f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.474565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:22.485607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.486397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.486675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.486942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.500321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:22.508048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:22.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:22.509775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 137/285] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:22.510494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.574485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:22.578006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b1e6f-bcc3-4a8d-b88d-b08e5ee2ccb2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.618767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822eea5-d127-49f9-a95a-a51f8dcf8153 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.626475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.627396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.627853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.628770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.630079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:22.630598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:22.632720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:22.649458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 149/286] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:22.650209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.659472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.660363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.660655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.660930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf/users/d14b14f068bc47fa9b3ea0f5dad6ce53/roles/26a2684e70634bea8eb3f6ef7eb3e58f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.662887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] RBAC: Authorizing `identity:create_grant(project_id=542addf9918145cbb654e539109817bf, user_id=d14b14f068bc47fa9b3ea0f5dad6ce53, role_id=26a2684e70634bea8eb3f6ef7eb3e58f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:22.664454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:22.682131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 138/287] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:51:22 2022] PUT /identity/v3/projects/542addf9918145cbb654e539109817bf/users/d14b14f068bc47fa9b3ea0f5dad6ce53/roles/26a2684e70634bea8eb3f6ef7eb3e58f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:22.682711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.764856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:22.776841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d02c-03e6-4f5b-85b0-9ba12bfc8136 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.818831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a517-c547-4c78-a618-56d810fa1970 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:22.826247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.826992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.827330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.827607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.828384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:22.828725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:22.830915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:22.841699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:22.844245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 150/288] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:22.853749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:22.867597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:22.868953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:22.869446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:22.869988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] PATH_INFO: `/v3/users/fc33b0d5c3414c38a8d417c4993fd08c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:22.886102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] RBAC: Authorizing `identity:get_user(user_id=fc33b0d5c3414c38a8d417c4993fd08c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:22.887978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:22.890352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 139/289] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/users/fc33b0d5c3414c38a8d417c4993fd08c => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:22.896466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:23.016162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fddcf9-43ca-4c22-9027-656de80c9f51 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:23.025574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da407a2e-7f8d-4c8b-909d-03031e22deea None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:23.062142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:23.063216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:23.063772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:23.064240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:23.065345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, user.id=fc33b0d5c3414c38a8d417c4993fd08c, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:23.065975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:23.067610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:23.073456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:23.074332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:23.074713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:23.074900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] PATH_INFO: `/v3/users/b694334693284efda8838d328c3f8f75` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:23.075088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 140/290] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/role_assignments?user.id=fc33b0d5c3414c38a8d417c4993fd08c&scope.system=all&role.id=36180a439e5845b8b09129d2ba66c697 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:23.080693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] RBAC: Authorizing `identity:get_user(user_id=b694334693284efda8838d328c3f8f75)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:23.080693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:23.080997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 151/291] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:22 2022] GET /identity/v3/users/b694334693284efda8838d328c3f8f75 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:23.089815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:23.141805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:23.208850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d200ea-9308-49ef-b99a-f02d07d655b9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:23.262448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:23.263369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:23.263822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:23.264249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:23.360274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:23.362019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:23.422117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:23.493668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 141/292] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:23.508479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:23.551781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:23.645907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bcf6-26af-41e5-a243-8b4da3d49c61 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:23.692195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d1960-e287-46fc-8409-2c33caa5da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:23.693132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d1960-e287-46fc-8409-2c33caa5da63 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:23.693413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d1960-e287-46fc-8409-2c33caa5da63 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:23.693683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d1960-e287-46fc-8409-2c33caa5da63 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:23.697344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d1960-e287-46fc-8409-2c33caa5da63 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:23.698857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d1960-e287-46fc-8409-2c33caa5da63 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:23.700898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 152/293] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:23 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:23.706445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:23.825396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096f83-f4ca-4f15-b49f-dc372c90ea6d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:23.867676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899b0fb-5385-44a7-9d0c-196aa917a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:23.868341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b0fb-5385-44a7-9d0c-196aa917a570 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:23.868619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b0fb-5385-44a7-9d0c-196aa917a570 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:23.868912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b0fb-5385-44a7-9d0c-196aa917a570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:23.869890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899b0fb-5385-44a7-9d0c-196aa917a570 None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=542addf9918145cbb654e539109817bf, user.id=b694334693284efda8838d328c3f8f75) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:23.870425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899b0fb-5385-44a7-9d0c-196aa917a570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:23.872190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899b0fb-5385-44a7-9d0c-196aa917a570 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:23.879075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 142/294] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:23 2022] GET /identity/v3/role_assignments?user.id=b694334693284efda8838d328c3f8f75&scope.project.id=542addf9918145cbb654e539109817bf&role.id=36180a439e5845b8b09129d2ba66c697 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:24.602783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06327-4ef2-4599-b87d-a4db113a5cca None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:24.603713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06327-4ef2-4599-b87d-a4db113a5cca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:24.604261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d06327-4ef2-4599-b87d-a4db113a5cca None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:24.606305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 153/295] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:24.611608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c717-dacf-4205-b5fd-f74563356b8d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:24.611894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c717-dacf-4205-b5fd-f74563356b8d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:24.612167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c717-dacf-4205-b5fd-f74563356b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:24.622817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:24.633628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a600c717-dacf-4205-b5fd-f74563356b8d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:24.634828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a600c717-dacf-4205-b5fd-f74563356b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:24.704334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 143/296] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:24.726618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06327-4ef2-4599-b87d-a4db113a5cca None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:24.745361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e1c14-e604-43db-b192-f8ed1de854fe None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:24.745650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e1c14-e604-43db-b192-f8ed1de854fe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:24.745929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e1c14-e604-43db-b192-f8ed1de854fe None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:24.747573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 144/297] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:24.753693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ac87c-a50c-4582-bf97-668c7a037a39 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:24.753984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ac87c-a50c-4582-bf97-668c7a037a39 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:24.754251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ac87c-a50c-4582-bf97-668c7a037a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:24.778407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-154ac87c-a50c-4582-bf97-668c7a037a39 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:24.779762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-154ac87c-a50c-4582-bf97-668c7a037a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:24.827565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:24.845214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d06327-4ef2-4599-b87d-a4db113a5cca None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:24.864223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 145/298] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:24.882708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:24.883720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:24.884135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:24.884538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:24.885861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:24.888295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ac87c-a50c-4582-bf97-668c7a037a39 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:24.888937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:24.891174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 154/299] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:24.896459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:24.951905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:24.991439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ac87c-a50c-4582-bf97-668c7a037a39 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.003381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc81a4-8a2b-4b3f-b062-8dee5ac560e1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.026404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:25.027188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.027463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.027788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.038626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:25.041883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:25.043126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.043620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.044082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] PATH_INFO: `/v3/groups` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.045028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:25.046668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:25.046872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:25.047878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:25.048685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:25.052709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 146/300] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:25.055621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:25.071703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 155/301] 10.222.0.35 () {60 vars in 1134 bytes} [Thu May 19 11:51:24 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:25.184931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583bcc-eca9-4394-bb61-11db66c71a20 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.213106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:25.226704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:25.227701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.228116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.228555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.229648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:25.230097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:25.231698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:25.241853 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 147/302] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:25.250633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:25.275085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:25.362994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318209d0-4ed3-405b-be10-114908cf32c1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.396534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efd457-e7b4-443c-b4d6-30b64348887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:25.397453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd457-e7b4-443c-b4d6-30b64348887b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.397723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd457-e7b4-443c-b4d6-30b64348887b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.397984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd457-e7b4-443c-b4d6-30b64348887b None admin] PATH_INFO: `/v3/users/74d40b9db8404a0d9e3abd699061edf0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.412124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efd457-e7b4-443c-b4d6-30b64348887b None admin] RBAC: Authorizing `identity:get_user(user_id=74d40b9db8404a0d9e3abd699061edf0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:25.413619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efd457-e7b4-443c-b4d6-30b64348887b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:25.415625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 156/303] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:25 2022] GET /identity/v3/users/74d40b9db8404a0d9e3abd699061edf0 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:25.421724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:25.443373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad267e7-bc73-41d1-9144-08af1d74e108 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.443669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad267e7-bc73-41d1-9144-08af1d74e108 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.443926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad267e7-bc73-41d1-9144-08af1d74e108 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.445597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 157/304] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:25.450617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f375-8ce3-4b88-b5e0-7722f9de38cb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.450908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f375-8ce3-4b88-b5e0-7722f9de38cb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.451186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731f375-8ce3-4b88-b5e0-7722f9de38cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.468370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5731f375-8ce3-4b88-b5e0-7722f9de38cb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:25.469598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5731f375-8ce3-4b88-b5e0-7722f9de38cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:25.531508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df64e12-67d8-41fe-96f5-99ee07c54462 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.545885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 158/305] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:25.572873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731f375-8ce3-4b88-b5e0-7722f9de38cb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:25.575066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef0e2-e413-49df-adeb-37554083a35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:25.575727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef0e2-e413-49df-adeb-37554083a35b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.576009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef0e2-e413-49df-adeb-37554083a35b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.576300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef0e2-e413-49df-adeb-37554083a35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.577023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:25.577213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef0e2-e413-49df-adeb-37554083a35b None admin] RBAC: Adding query filter params (role.id=26a2684e70634bea8eb3f6ef7eb3e58f, user.id=74d40b9db8404a0d9e3abd699061edf0, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:25.577525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef0e2-e413-49df-adeb-37554083a35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:25.578998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef0e2-e413-49df-adeb-37554083a35b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:25.584588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 148/306] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 11:51:25 2022] GET /identity/v3/role_assignments?user.id=74d40b9db8404a0d9e3abd699061edf0&scope.system=all&role.id=26a2684e70634bea8eb3f6ef7eb3e58f => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:25.690979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731f375-8ce3-4b88-b5e0-7722f9de38cb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.694461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc790ee-6d6e-4f47-af77-a0fb9192543d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.694741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc790ee-6d6e-4f47-af77-a0fb9192543d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.695011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc790ee-6d6e-4f47-af77-a0fb9192543d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.697904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 149/307] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:25.702463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399c2aa-f754-4a7f-9942-1876581ea6c2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.702748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399c2aa-f754-4a7f-9942-1876581ea6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.703024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399c2aa-f754-4a7f-9942-1876581ea6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.726033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7399c2aa-f754-4a7f-9942-1876581ea6c2 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:25.727289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7399c2aa-f754-4a7f-9942-1876581ea6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:25.733525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:25.734335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.734618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.734889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.746583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:25.754489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:25.755456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:25.756243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 159/308] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:25.763167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:25.778109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:25.819122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 150/309] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:25.842028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399c2aa-f754-4a7f-9942-1876581ea6c2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:25.848009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:25.898857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b05e3-9116-4df6-acc3-9eb8f7beef4b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.943858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:25.944449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:25.944767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:25.945040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:25.946041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:25.946354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:25.948215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:25.960849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 160/310] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:25.963029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399c2aa-f754-4a7f-9942-1876581ea6c2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:25.966651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:25.999540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.000545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.000938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.001282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.012129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:26.020426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:26.021364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:26.022154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:26.026384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 151/311] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:26.027303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:26.077702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:26.090914 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de71e1-13ef-4215-be69-97028bcb99a9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:26.117608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:26.127183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.128169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.128519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.129229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] PATH_INFO: `/v3/users/d14b14f068bc47fa9b3ea0f5dad6ce53` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.130211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=d14b14f068bc47fa9b3ea0f5dad6ce53)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:26.131734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:26.134017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 161/312] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:25 2022] GET /identity/v3/users/d14b14f068bc47fa9b3ea0f5dad6ce53 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:26.139313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:26.142218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba6bf-722b-404f-952b-65ef4752ee44 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:26.177085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.178249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.178747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.179221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.180174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:26.180692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:26.182321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:26.191304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 152/313] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:26.200239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:26.247650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f78c-c4d5-4342-838b-e2e22f124cd1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:26.285627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.286388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.286695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.287051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.335528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cd443-fd74-4b50-8c5d-11b5c98f5017 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:26.337608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:26.359115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:26.367613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:26.369236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:26.377151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.378419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.378873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.379316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] PATH_INFO: `/v3/users/fc33b0d5c3414c38a8d417c4993fd08c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.380780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] RBAC: Authorizing `identity:get_user(user_id=fc33b0d5c3414c38a8d417c4993fd08c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:26.382516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:26.384871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 153/314] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:26 2022] GET /identity/v3/users/fc33b0d5c3414c38a8d417c4993fd08c => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:26.389978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:26.480473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 162/315] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:26.481401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:26.527506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef047f-1916-40c3-8fe9-35c7ca6e43c8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:26.573018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.574823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.575306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.575786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] PATH_INFO: `/v3/system/users/fc33b0d5c3414c38a8d417c4993fd08c/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.577990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fc33b0d5c3414c38a8d417c4993fd08c, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:26.579879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:26.583396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:26.593695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 154/316] 10.222.0.35 () {58 vars in 1334 bytes} [Thu May 19 11:51:26 2022] PUT /identity/v3/system/users/fc33b0d5c3414c38a8d417c4993fd08c/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:26.594441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ba060-228a-4a48-bd87-d28c2fd59c4f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:26.639011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8cb78-6ec6-4237-815a-48af0bc7f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.639953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cb78-6ec6-4237-815a-48af0bc7f1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.640287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cb78-6ec6-4237-815a-48af0bc7f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.640561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cb78-6ec6-4237-815a-48af0bc7f1f7 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.641862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8cb78-6ec6-4237-815a-48af0bc7f1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:26.643448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8cb78-6ec6-4237-815a-48af0bc7f1f7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:26.645668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 163/317] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:26 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:26.651587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:26.698220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:26.770710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c272739-b417-48e8-b001-7851bcb37887 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:26.807658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05ac03-4ab1-49cd-9dc9-d61b93053f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:26.808316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ac03-4ab1-49cd-9dc9-d61b93053f42 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:26.808595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ac03-4ab1-49cd-9dc9-d61b93053f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:26.808906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ac03-4ab1-49cd-9dc9-d61b93053f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:26.809748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05ac03-4ab1-49cd-9dc9-d61b93053f42 None admin] RBAC: Adding query filter params (role.id=26a2684e70634bea8eb3f6ef7eb3e58f, scope.project.id=542addf9918145cbb654e539109817bf, user.id=d14b14f068bc47fa9b3ea0f5dad6ce53) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:26.810061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05ac03-4ab1-49cd-9dc9-d61b93053f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:26.811561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05ac03-4ab1-49cd-9dc9-d61b93053f42 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:26.818095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 155/318] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:26 2022] GET /identity/v3/role_assignments?user.id=d14b14f068bc47fa9b3ea0f5dad6ce53&scope.project.id=542addf9918145cbb654e539109817bf&role.id=26a2684e70634bea8eb3f6ef7eb3e58f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:27.463715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13fe4-0de7-4b62-869b-d6ee47c89aff None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:27.464247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13fe4-0de7-4b62-869b-d6ee47c89aff None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:27.464247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13fe4-0de7-4b62-869b-d6ee47c89aff None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:27.465616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 164/319] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:27.471111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce667e4-a7b6-4717-8a57-1bfa9a6ffb48 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:27.471530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce667e4-a7b6-4717-8a57-1bfa9a6ffb48 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:27.471714 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce667e4-a7b6-4717-8a57-1bfa9a6ffb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:27.489022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8ce667e4-a7b6-4717-8a57-1bfa9a6ffb48 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:27.490185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8ce667e4-a7b6-4717-8a57-1bfa9a6ffb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:27.568698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 156/320] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:27.585956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13fe4-0de7-4b62-869b-d6ee47c89aff None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:27.695582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13fe4-0de7-4b62-869b-d6ee47c89aff None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:27.734390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6374-3d33-42bf-9916-4cfa629e6b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:27.735114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6374-3d33-42bf-9916-4cfa629e6b35 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:27.735390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6374-3d33-42bf-9916-4cfa629e6b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:27.735649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6374-3d33-42bf-9916-4cfa629e6b35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:27.737090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6374-3d33-42bf-9916-4cfa629e6b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:27.738567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6374-3d33-42bf-9916-4cfa629e6b35 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:27.740442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 165/321] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:27.746101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce667e4-a7b6-4717-8a57-1bfa9a6ffb48 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:27.774740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:27.850937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce667e4-a7b6-4717-8a57-1bfa9a6ffb48 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:27.874124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773a95-50fa-45e5-b410-3918b2fb1e88 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:27.874456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773a95-50fa-45e5-b410-3918b2fb1e88 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:27.874652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773a95-50fa-45e5-b410-3918b2fb1e88 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:27.876356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 166/322] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:27.881083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855b42-54a9-49c4-9f2d-296c997e6813 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:27.881355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855b42-54a9-49c4-9f2d-296c997e6813 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:27.881610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855b42-54a9-49c4-9f2d-296c997e6813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:27.887163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:27.888019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:27.888159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:27.888368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] PATH_INFO: `/v3/groups` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:27.889092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:27.891282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:27.900161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-57855b42-54a9-49c4-9f2d-296c997e6813 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:27.901463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-57855b42-54a9-49c4-9f2d-296c997e6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:27.910320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 157/323] 10.222.0.35 () {60 vars in 1134 bytes} [Thu May 19 11:51:27 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:51:27.928587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:27.977984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 167/324] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:28.000342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:28.095309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:28.110991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56eadcd-0339-423c-b472-cef7bf8c699d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:28.157172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:28.157964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:28.158240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:28.158494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:28.172430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:28.180533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:28.181494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:28.182357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 158/325] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:28.187944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855b42-54a9-49c4-9f2d-296c997e6813 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:28.299390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855b42-54a9-49c4-9f2d-296c997e6813 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:28.335431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:28.336108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:28.336388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:28.336667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:28.337431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:28.337736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:28.339303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:28.348946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 168/326] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:28.358766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:28.470216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99cba6-2add-445d-8bf5-051541721876 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:28.516665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d44c1-a8c1-4a77-9ff4-c2182bb78e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:28.516665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d44c1-a8c1-4a77-9ff4-c2182bb78e0c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:28.516665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d44c1-a8c1-4a77-9ff4-c2182bb78e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:28.516665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d44c1-a8c1-4a77-9ff4-c2182bb78e0c None admin] PATH_INFO: `/v3/users/74d40b9db8404a0d9e3abd699061edf0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:28.517449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d44c1-a8c1-4a77-9ff4-c2182bb78e0c None admin] RBAC: Authorizing `identity:get_user(user_id=74d40b9db8404a0d9e3abd699061edf0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:28.517449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d44c1-a8c1-4a77-9ff4-c2182bb78e0c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:28.517449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 159/327] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:28 2022] GET /identity/v3/users/74d40b9db8404a0d9e3abd699061edf0 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:28.525197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:28.565844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:28.660390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafd98-92fd-4568-82ba-c33162e4f2c7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:28.698848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a054052-e828-49b6-a640-a62cbafb8488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:28.699721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a054052-e828-49b6-a640-a62cbafb8488 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:28.700006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a054052-e828-49b6-a640-a62cbafb8488 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:28.700275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a054052-e828-49b6-a640-a62cbafb8488 None admin] PATH_INFO: `/v3/system/users/74d40b9db8404a0d9e3abd699061edf0/roles/26a2684e70634bea8eb3f6ef7eb3e58f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:28.701832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a054052-e828-49b6-a640-a62cbafb8488 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74d40b9db8404a0d9e3abd699061edf0, role_id=26a2684e70634bea8eb3f6ef7eb3e58f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:28.703257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a054052-e828-49b6-a640-a62cbafb8488 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:28.717748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 169/328] 10.222.0.35 () {58 vars in 1334 bytes} [Thu May 19 11:51:28 2022] PUT /identity/v3/system/users/74d40b9db8404a0d9e3abd699061edf0/roles/26a2684e70634bea8eb3f6ef7eb3e58f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:28.923641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b3346-4811-4eca-9f46-b59976511d6a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:28.923832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b3346-4811-4eca-9f46-b59976511d6a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:28.924105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b3346-4811-4eca-9f46-b59976511d6a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:28.925666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 160/329] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:28.931915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2ac1-6186-40ad-888a-a1474d33ca90 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:28.932205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2ac1-6186-40ad-888a-a1474d33ca90 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:28.932473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2ac1-6186-40ad-888a-a1474d33ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:28.951138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-446b2ac1-6186-40ad-888a-a1474d33ca90 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:28.952403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-446b2ac1-6186-40ad-888a-a1474d33ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:29.028825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 170/330] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:29.053036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b3346-4811-4eca-9f46-b59976511d6a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:29.077713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:29.204406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b3346-4811-4eca-9f46-b59976511d6a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:29.243621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:29.244453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:29.244783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:29.245056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:29.257356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:29.265218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:29.266478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:29.268452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 161/331] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:29.276947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2ac1-6186-40ad-888a-a1474d33ca90 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:29.299464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:29.407751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2ac1-6186-40ad-888a-a1474d33ca90 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:29.450011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:29.451063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:29.451544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:29.452036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:29.453036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:29.453546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:29.455258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:29.470427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 171/332] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:29.475770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:29.609035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:29.624388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930c871-5525-44e5-b9f7-ac4bb8d868dc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:29.668616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43697c7f-79ac-4ecb-bd0c-5013d841dbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:29.669542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697c7f-79ac-4ecb-bd0c-5013d841dbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:29.669823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697c7f-79ac-4ecb-bd0c-5013d841dbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:29.670096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697c7f-79ac-4ecb-bd0c-5013d841dbb1 None admin] PATH_INFO: `/v3/users/fc33b0d5c3414c38a8d417c4993fd08c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:29.671448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43697c7f-79ac-4ecb-bd0c-5013d841dbb1 None admin] RBAC: Authorizing `identity:get_user(user_id=fc33b0d5c3414c38a8d417c4993fd08c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:29.673190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43697c7f-79ac-4ecb-bd0c-5013d841dbb1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:29.675325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 162/333] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:29 2022] GET /identity/v3/users/fc33b0d5c3414c38a8d417c4993fd08c => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:29.685813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:29.820089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:29.842074 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aeb09-ab52-4e2e-a1f9-55bca38d0e7c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:29.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ed2f4-9a2d-4e24-8cbe-a91c047ea9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:29.884094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ed2f4-9a2d-4e24-8cbe-a91c047ea9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:29.884370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ed2f4-9a2d-4e24-8cbe-a91c047ea9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:29.884719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ed2f4-9a2d-4e24-8cbe-a91c047ea9e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:29.885669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ed2f4-9a2d-4e24-8cbe-a91c047ea9e4 None admin] RBAC: Adding query filter params (role.id=36180a439e5845b8b09129d2ba66c697, user.id=fc33b0d5c3414c38a8d417c4993fd08c, scope.system=all) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:29.885979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ed2f4-9a2d-4e24-8cbe-a91c047ea9e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:29.887421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ed2f4-9a2d-4e24-8cbe-a91c047ea9e4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:29.901154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 172/334] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 11:51:29 2022] GET /identity/v3/role_assignments?user.id=fc33b0d5c3414c38a8d417c4993fd08c&scope.system=all&role.id=36180a439e5845b8b09129d2ba66c697 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:31.221657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a10d-a054-4a18-b4c3-1260ee9fac36 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.222182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a10d-a054-4a18-b4c3-1260ee9fac36 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.222182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a10d-a054-4a18-b4c3-1260ee9fac36 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.223748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 163/335] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:31.229399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef139-f443-4f34-bc07-6e179f583301 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.229938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef139-f443-4f34-bc07-6e179f583301 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.229938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eef139-f443-4f34-bc07-6e179f583301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.251670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-06eef139-f443-4f34-bc07-6e179f583301 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:31.252903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-06eef139-f443-4f34-bc07-6e179f583301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:31.340245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 173/336] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:31.383805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49a10d-a054-4a18-b4c3-1260ee9fac36 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:31.437124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f917d2-cf8f-45a2-a620-a145737cbbc1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.437443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f917d2-cf8f-45a2-a620-a145737cbbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.437677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f917d2-cf8f-45a2-a620-a145737cbbc1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.439200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 174/337] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:31.444679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f4e3-a335-4737-82f1-ae2e6ff50537 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.444974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f4e3-a335-4737-82f1-ae2e6ff50537 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.445449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f4e3-a335-4737-82f1-ae2e6ff50537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.476832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8a02f4e3-a335-4737-82f1-ae2e6ff50537 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:31.478351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8a02f4e3-a335-4737-82f1-ae2e6ff50537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:31.552469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49a10d-a054-4a18-b4c3-1260ee9fac36 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:31.620578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:31.621414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.621690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.621959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.629721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:31.643429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:31.651237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:31.652143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:31.652963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:31.657067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 164/338] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:31.665728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 175/339] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:31.666845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:31.676846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:31.711787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f4e3-a335-4737-82f1-ae2e6ff50537 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:31.794664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af50ab-31bc-40d1-ada6-2cfed1a5ae7e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:31.836302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42cad-672c-43a5-9faa-4b554d3b4eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:31.837002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42cad-672c-43a5-9faa-4b554d3b4eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.837279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42cad-672c-43a5-9faa-4b554d3b4eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.837545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42cad-672c-43a5-9faa-4b554d3b4eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.838750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42cad-672c-43a5-9faa-4b554d3b4eb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:31.839057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42cad-672c-43a5-9faa-4b554d3b4eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:31.840442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42cad-672c-43a5-9faa-4b554d3b4eb5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:31.850129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 165/340] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:31.851461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452427-77b3-4436-970f-8360cc88d593 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.851742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452427-77b3-4436-970f-8360cc88d593 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.852007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452427-77b3-4436-970f-8360cc88d593 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.854733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 166/341] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:31.862243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9c27-9d8f-4ba6-907a-8cddb35f6904 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.862530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9c27-9d8f-4ba6-907a-8cddb35f6904 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.862801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9c27-9d8f-4ba6-907a-8cddb35f6904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.886345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-efce9c27-9d8f-4ba6-907a-8cddb35f6904 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:31.887834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-efce9c27-9d8f-4ba6-907a-8cddb35f6904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:31.892775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f4e3-a335-4737-82f1-ae2e6ff50537 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:31.933365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:31.936714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:31.937014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:31.937317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:31.950911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:31.955877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:31.960821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:31.961909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 176/342] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:31.963548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:31.965500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 167/343] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:31.967767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce9c27-9d8f-4ba6-907a-8cddb35f6904 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:32.025052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:32.099294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce9c27-9d8f-4ba6-907a-8cddb35f6904 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:32.118577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2845d0-7057-4124-a4ea-62d095e0087e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:32.138978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:32.139650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.139930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.140203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.141251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:32.141570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:32.143131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:32.155910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 168/344] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:32.156929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:32.205986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:32.206649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.206929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.207202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.226001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:32.305613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f32a-4829-4262-8f2f-95ab49bcfc16 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:32.318814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:32.322500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:32.373100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:32.374274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.374777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.375252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.391705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:32.404806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:32.421495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:32.422483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:32.423289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:32.426399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 169/345] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:32.427449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:32.442566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 177/346] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:32.450756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:32.577990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d000-bddf-48d4-b9ca-14779a09a436 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:32.580612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cf74-4dd0-4f5b-8985-3ee543d42243 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:32.601999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:32.622282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:32.623577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.624053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.624499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.626027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:32.627683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:32.633661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27541dc-fbfe-46ef-a32b-fda0eba655a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:32.633661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27541dc-fbfe-46ef-a32b-fda0eba655a9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.633661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27541dc-fbfe-46ef-a32b-fda0eba655a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.633661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27541dc-fbfe-46ef-a32b-fda0eba655a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.634318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 178/347] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:32 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:32.635434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:32.666362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:32.723448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27541dc-fbfe-46ef-a32b-fda0eba655a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:32.724945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27541dc-fbfe-46ef-a32b-fda0eba655a9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:32.752692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a020-76da-4bfe-a952-d9ab4bcef694 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:32.798606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998e2b-a73a-49c9-a1f8-caea89ce4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:32.799277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998e2b-a73a-49c9-a1f8-caea89ce4bbc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.799561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998e2b-a73a-49c9-a1f8-caea89ce4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.799836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998e2b-a73a-49c9-a1f8-caea89ce4bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.800595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998e2b-a73a-49c9-a1f8-caea89ce4bbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:32.800949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998e2b-a73a-49c9-a1f8-caea89ce4bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:32.802330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998e2b-a73a-49c9-a1f8-caea89ce4bbc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:32.811640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 179/348] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:32.815105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb10e-800e-4bfa-829f-5d631bb13dc3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.815105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb10e-800e-4bfa-829f-5d631bb13dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.815105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb10e-800e-4bfa-829f-5d631bb13dc3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.815105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 180/349] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:32.815409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bb10e-800e-4bfa-829f-5d631bb13dc3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:32.853282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 170/350] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:32.854463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c67ae-bb68-4a6d-acbc-c21da1905389 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.854740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c67ae-bb68-4a6d-acbc-c21da1905389 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.855014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c67ae-bb68-4a6d-acbc-c21da1905389 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:32.857025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 171/351] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:32.857731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c67ae-bb68-4a6d-acbc-c21da1905389 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:32.884140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:32.921622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:32.941003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bb10e-800e-4bfa-829f-5d631bb13dc3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:32.993375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71d12-7166-4c62-aeff-6d53a0dbd3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:32.994292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71d12-7166-4c62-aeff-6d53a0dbd3df None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:32.994567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71d12-7166-4c62-aeff-6d53a0dbd3df None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:32.994836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71d12-7166-4c62-aeff-6d53a0dbd3df None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.003653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c67ae-bb68-4a6d-acbc-c21da1905389 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:33.004841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71d12-7166-4c62-aeff-6d53a0dbd3df None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:33.006317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71d12-7166-4c62-aeff-6d53a0dbd3df None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:33.008032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 181/352] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:32 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:33.009410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd811f-2697-4bd7-ae81-c0fdf4b6a2d0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.009722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd811f-2697-4bd7-ae81-c0fdf4b6a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.010024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd811f-2697-4bd7-ae81-c0fdf4b6a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.033733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-32cd811f-2697-4bd7-ae81-c0fdf4b6a2d0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:33.035216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-32cd811f-2697-4bd7-ae81-c0fdf4b6a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:33.048118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:33.048487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.048816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.049092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 182/353] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:33.122747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dd011-e917-4815-8700-6e7367985c6d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.123029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dd011-e917-4815-8700-6e7367985c6d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.123394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dd011-e917-4815-8700-6e7367985c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.138131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:33.139602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:33.144009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1c3dd011-e917-4815-8700-6e7367985c6d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:33.146917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c3dd011-e917-4815-8700-6e7367985c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:33.164505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:33.229195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 183/354] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:33.230823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dd011-e917-4815-8700-6e7367985c6d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:33.244049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:33.262234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 172/355] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:33.263077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:33.371855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dd011-e917-4815-8700-6e7367985c6d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:33.421333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92db2-99ed-44ea-96d9-fb6f0b1e8fed None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:33.431182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d512ccf-8bfb-4014-8c0f-973914c7db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:33.432683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d512ccf-8bfb-4014-8c0f-973914c7db5f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.433036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d512ccf-8bfb-4014-8c0f-973914c7db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.433378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d512ccf-8bfb-4014-8c0f-973914c7db5f None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.436960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d512ccf-8bfb-4014-8c0f-973914c7db5f None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:33.440212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d512ccf-8bfb-4014-8c0f-973914c7db5f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:33.441856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 184/356] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:33 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:33.443112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f91ee2-064c-43d3-bb42-5081654d1601 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.443392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f91ee2-064c-43d3-bb42-5081654d1601 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.443664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f91ee2-064c-43d3-bb42-5081654d1601 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.445167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 185/357] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:33.448604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f91ee2-064c-43d3-bb42-5081654d1601 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:33.451804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:33.476685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:33.478404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.478404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.478404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.478828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:33.479138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:33.480583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:33.487990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 173/358] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:33 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=36180a439e5845b8b09129d2ba66c697 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:33.489621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:33.560246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:33.613562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f91ee2-064c-43d3-bb42-5081654d1601 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:33.659038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616843f-c539-46f4-a12e-0d2a8d635ece None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:33.674851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:33.676021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.676854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.677417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.693735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:33.703089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:33.704038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:33.704871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 186/359] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:33.705536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:33.717807 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:33.718635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.718913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.719189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.749794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:33.761591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:33.762517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:33.763409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:33.768595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 174/360] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:33.768595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:33.837484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:33.858118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689e300-271f-43d2-a5c6-8f26dbd24ff4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:33.895976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab927fb-f4cb-4126-b1ff-406a8601fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:33.896940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab927fb-f4cb-4126-b1ff-406a8601fd50 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.897226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab927fb-f4cb-4126-b1ff-406a8601fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.897501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab927fb-f4cb-4126-b1ff-406a8601fd50 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.899486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab927fb-f4cb-4126-b1ff-406a8601fd50 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:33.900895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab927fb-f4cb-4126-b1ff-406a8601fd50 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:33.902624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 187/361] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:33 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:33.903797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b653-03d5-45f4-9301-ace1877d21cc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.904081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b653-03d5-45f4-9301-ace1877d21cc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.904424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b653-03d5-45f4-9301-ace1877d21cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.916401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:33.922805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1ee8b653-03d5-45f4-9301-ace1877d21cc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:33.924611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1ee8b653-03d5-45f4-9301-ace1877d21cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:33.929017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58678-4e66-477c-9610-43f9b05734e3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:33.974680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:33.975612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:33.975929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:33.976207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:33.978070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:33.979545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:33.983310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 175/362] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:33 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:33.983310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.014625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 188/363] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:34.015382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b653-03d5-45f4-9301-ace1877d21cc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.112439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14013-f9e0-4f54-a227-3bab8dd21828 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.124499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:34.136502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b653-03d5-45f4-9301-ace1877d21cc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.157524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.158198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.158636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.158963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.160018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:34.160327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:34.161773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:34.172510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 176/364] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:34.173674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.188734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.189342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.189621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.189894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.190676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:34.190950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:34.192334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:34.194981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:34.212329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 189/365] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:34.214082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.300855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487d45-c2a3-4418-967f-2bf3cb0b1985 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.329243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769307f8-2391-42cf-b6bc-51694a350028 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.337592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.338498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.338775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.339043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.341292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:34.342750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:34.344406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 177/366] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:34.345201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.378385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.379253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.379541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.380115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.381201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:34.381513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:34.384347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:34.391648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 190/367] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:34.392465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.408006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:34.471939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bf15e-c4c5-417d-8a8d-8590261d26b7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.482488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:34.512897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.513871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.513871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.514150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.527664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:34.534984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b37d9-8df0-4cd0-bd62-2d7754f85d7c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:34.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:34.536885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:34.537805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 178/368] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:34.538477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.582095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.583092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.583444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.583775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] PATH_INFO: `/v3/users/74d40b9db8404a0d9e3abd699061edf0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.585153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] RBAC: Authorizing `identity:get_user(user_id=74d40b9db8404a0d9e3abd699061edf0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:34.587310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:34.589970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 191/369] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/users/74d40b9db8404a0d9e3abd699061edf0 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:34.590851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.656036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:34.659744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7026-a81c-49f4-a1f0-3ce284d985e2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.695370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.696023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.696296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.696563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.738358 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeef9ca-dfe0-4f23-826e-f3d7bdaefc04 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:34.769230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:34.774558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:34.775223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:34.775558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:34.775831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:34.776708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=542addf9918145cbb654e539109817bf) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:34.777020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:34.778475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:34.780806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:34.783205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:34.788789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 192/370] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=542addf9918145cbb654e539109817bf&role.id=36180a439e5845b8b09129d2ba66c697 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:34.789769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.904143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 179/371] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:34.905053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:34.908913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:35.013595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbe7cf-823a-4384-9f54-5e437adc2187 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:35.048998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:35.050357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:35.050357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:35.050357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:35.052674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] RBAC: Adding query filter params (role.id=26a2684e70634bea8eb3f6ef7eb3e58f, user.id=74d40b9db8404a0d9e3abd699061edf0, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:35.052674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:35.052837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:35.075794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248705b-2be5-455a-a13f-b102fbe0334b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:35.079448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 180/372] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/role_assignments?user.id=74d40b9db8404a0d9e3abd699061edf0&scope.system=all&role.id=26a2684e70634bea8eb3f6ef7eb3e58f => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:35.080367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:35.147830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:35.178885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:35.179566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:35.179840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:35.180248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:35.181152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:35.181597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:35.183042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:35.198592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd82d9b-c973-40d4-8358-9f64c38a7bd9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:35.198934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 193/373] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:35.204265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:35.264261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:35.267121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:35.267417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:35.267693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:35.270196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:35.273804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:35.278445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 181/374] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:35 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:35.284220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:35.316331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:35.365868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2b93-6396-4024-b81c-976f93ece0b3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:35.399429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ced824-c273-44bd-9897-f6e79f40bc0f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:35.402491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:35.403163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:35.403443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:35.403715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:35.441330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:35.451998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:35.453027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:35.453990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:35.454337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:35.455850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:35.459759 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:35.462800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 182/375] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:35 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:35.469675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:35.543649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:35.545181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:35.592430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f1f0-252b-44ca-bcd3-01f63ea6536f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:35.632392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:35.633080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:35.633357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:35.633917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:35.634786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=542addf9918145cbb654e539109817bf) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:35.635339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:35.636812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:35.644023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 183/376] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:35 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=542addf9918145cbb654e539109817bf&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:35.665589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:35.726851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 194/377] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:35.732253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:35.804244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:35.871048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edadb9-a69d-4512-a8dc-e3458f203a58 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:35.917526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:35.918402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:35.918678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:35.918948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] PATH_INFO: `/v3/projects/f8b904bb5322427b8794f68069b5704c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:35.921489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b904bb5322427b8794f68069b5704c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:35.923216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:35.925576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 184/378] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:35 2022] GET /identity/v3/projects/f8b904bb5322427b8794f68069b5704c => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:35.933816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:36.065691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d086-e5f2-44b4-847c-280c2e2548d0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:36.112037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61308f8-a391-4fc1-8130-40a568870ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:36.112971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61308f8-a391-4fc1-8130-40a568870ade None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:36.113250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61308f8-a391-4fc1-8130-40a568870ade None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:36.113519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61308f8-a391-4fc1-8130-40a568870ade None admin] PATH_INFO: `/v3/groups/95e9f2dfec8c4563ad4eec6800387667` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:36.118968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61308f8-a391-4fc1-8130-40a568870ade None admin] RBAC: Authorizing `identity:get_group(group_id=95e9f2dfec8c4563ad4eec6800387667)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:36.120439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61308f8-a391-4fc1-8130-40a568870ade None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:36.122153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 195/379] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:35 2022] GET /identity/v3/groups/95e9f2dfec8c4563ad4eec6800387667 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:36.128020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:36.159714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf151-8218-46ab-8848-357b95003b16 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:36.160038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf151-8218-46ab-8848-357b95003b16 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:36.160263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf151-8218-46ab-8848-357b95003b16 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:36.161711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 196/380] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:36.178190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181057d0-f68a-49e2-a358-4c6be2127360 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:36.178466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181057d0-f68a-49e2-a358-4c6be2127360 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:36.178901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181057d0-f68a-49e2-a358-4c6be2127360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:36.205677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-181057d0-f68a-49e2-a358-4c6be2127360 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:36.206884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-181057d0-f68a-49e2-a358-4c6be2127360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:36.222239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:36.267784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d761ed5-0aa1-492b-8212-dc4318a8f3e3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:36.309001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:36.319347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:36.319944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:36.320231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:36.320512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:36.321397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] RBAC: Adding query filter params (group.id=95e9f2dfec8c4563ad4eec6800387667, role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=f8b904bb5322427b8794f68069b5704c) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:36.321715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:36.323202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:36.330201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 197/381] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:36.340097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 185/382] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:36 2022] GET /identity/v3/role_assignments?group.id=95e9f2dfec8c4563ad4eec6800387667&scope.project.id=f8b904bb5322427b8794f68069b5704c&role.id=aafa433396f14143bb549af1f2b6219b => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:36.390218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181057d0-f68a-49e2-a358-4c6be2127360 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:36.545412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181057d0-f68a-49e2-a358-4c6be2127360 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:36.587871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:36.589225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:36.589701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:36.590160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:36.601049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:36.611166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:36.612072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:36.612902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:36.615314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 198/383] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:36.625749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:36.760540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e78790-a310-4b47-8286-27fc352ec860 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:36.806241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:36.807192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:36.807614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:36.808022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:36.808962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:36.809408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:36.810933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:36.824757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 186/384] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:36.830310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:36.848308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:36.961318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a9b42-4c84-470e-b63e-ecc43a4a2a5d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:37.014680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:37.015562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.015843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.016113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.017328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:37.018775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:37.020395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 199/385] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:36 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:37.026088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:37.092544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:37.158333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877994f2-b0be-4431-a331-45208c9fd8b8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:37.206290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dcbc6-a0d1-433a-836d-fcdacd9aef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:37.207183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dcbc6-a0d1-433a-836d-fcdacd9aef08 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.207465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dcbc6-a0d1-433a-836d-fcdacd9aef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.207738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dcbc6-a0d1-433a-836d-fcdacd9aef08 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.213676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dcbc6-a0d1-433a-836d-fcdacd9aef08 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:37.215190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dcbc6-a0d1-433a-836d-fcdacd9aef08 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:37.217481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 187/386] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:37 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:37.223374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:37.332832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:37.355212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90958-1323-4cab-ac38-03f778a8d47c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:37.389806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36590b85-af72-4b43-9c39-b76afeb0c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:37.390699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590b85-af72-4b43-9c39-b76afeb0c4e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.390977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590b85-af72-4b43-9c39-b76afeb0c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.391243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590b85-af72-4b43-9c39-b76afeb0c4e2 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/groups/413e3aa7b06942d69538b7804b5850ca/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.393237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36590b85-af72-4b43-9c39-b76afeb0c4e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4768ad428ad24ba3b987e77a8d5007ee, group_id=413e3aa7b06942d69538b7804b5850ca, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:37.394713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36590b85-af72-4b43-9c39-b76afeb0c4e2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:37.418523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 200/387] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 11:51:37 2022] PUT /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/groups/413e3aa7b06942d69538b7804b5850ca/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:37.420093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba70d-e9f6-458a-a547-a388291ff40c None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.420459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba70d-e9f6-458a-a547-a388291ff40c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.420762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba70d-e9f6-458a-a547-a388291ff40c None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.422386 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 188/388] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:37.438527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee065c-f6d9-4f2e-9f46-681a53340209 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.439009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee065c-f6d9-4f2e-9f46-681a53340209 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.439215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee065c-f6d9-4f2e-9f46-681a53340209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.465186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fdee065c-f6d9-4f2e-9f46-681a53340209 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:37.466388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fdee065c-f6d9-4f2e-9f46-681a53340209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:37.583439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 201/389] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:37.595821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898ff3b-341d-4ec0-9bc0-823c18189089 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.596114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898ff3b-341d-4ec0-9bc0-823c18189089 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.596377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898ff3b-341d-4ec0-9bc0-823c18189089 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.598049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 189/390] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:37.603845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b044-ca5b-41a0-91e0-15709fd28421 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.604119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b044-ca5b-41a0-91e0-15709fd28421 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.604393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b044-ca5b-41a0-91e0-15709fd28421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.615900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898ff3b-341d-4ec0-9bc0-823c18189089 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:37.624455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-20d9b044-ca5b-41a0-91e0-15709fd28421 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:37.625688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-20d9b044-ca5b-41a0-91e0-15709fd28421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:37.704108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:37.715096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 202/391] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:37.742681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9b044-ca5b-41a0-91e0-15709fd28421 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:37.783107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898ff3b-341d-4ec0-9bc0-823c18189089 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:37.822359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:37.853124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:37.853983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.854259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.854525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.874228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:37.882293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:37.883183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:37.883968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 190/392] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:37.890509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:37.905101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9b044-ca5b-41a0-91e0-15709fd28421 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:37.986333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:37.987502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:37.995114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:37.995759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:37.997814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4adce-22e1-4469-b376-7f281223695c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.025600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:38.037801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:38.038714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:38.039508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 203/393] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:38.047457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:38.049105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:38.049786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.050056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.050322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.051071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:38.051372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:38.052769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:38.071446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 191/394] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:38.078376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:38.124596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:38.182342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:38.186065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f198a66-a1b4-4ba3-9394-130ca7844b06 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.221931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:38.222796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.223073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.223339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.224512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:38.226111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:38.228041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 192/395] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:38 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:38.233322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:38.257899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a4e45-c6c1-4da1-ad6d-25df8e87bf45 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.321049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:38.321825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.322163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.322442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.323206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:38.323513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:38.325116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:38.342232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 204/396] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:38.342800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdb742-0d9e-4df0-a370-3184997b6374 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.349650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:38.358646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:38.382349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:38.383311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.383653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.383983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.385308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:38.386874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:38.389140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 193/397] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:38 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:38.395118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:38.553798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a818b-d6ba-40e9-8d3d-9df2a9454894 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.594163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916454e2-c0c7-4bc0-8fd7-2c47410795aa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.594511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:38.628156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:38.629225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.629623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.629989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/groups/413e3aa7b06942d69538b7804b5850ca/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.632262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] RBAC: Authorizing `identity:create_grant(project_id=4768ad428ad24ba3b987e77a8d5007ee, group_id=413e3aa7b06942d69538b7804b5850ca, role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:38.633816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:38.649693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f648d3b-b2fa-491d-b509-f39dba8acc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:38.652884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648d3b-b2fa-491d-b509-f39dba8acc1b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.653172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648d3b-b2fa-491d-b509-f39dba8acc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.654085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648d3b-b2fa-491d-b509-f39dba8acc1b None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.656301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 194/398] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 11:51:38 2022] PUT /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee/groups/413e3aa7b06942d69538b7804b5850ca/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:51:38.656500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f648d3b-b2fa-491d-b509-f39dba8acc1b None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:38.658053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f648d3b-b2fa-491d-b509-f39dba8acc1b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:38.660192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 205/399] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:38 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:38.665754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:38.723078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:38.731724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ff6f-24af-4c5c-a9e8-18f42768134c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.732034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ff6f-24af-4c5c-a9e8-18f42768134c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.732267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ff6f-24af-4c5c-a9e8-18f42768134c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.733902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 206/400] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:38.739298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c8b0-c4b7-4e46-83e9-2824b9718158 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.739584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c8b0-c4b7-4e46-83e9-2824b9718158 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.739928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8c8b0-c4b7-4e46-83e9-2824b9718158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.785512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cd9b5-d30b-4f99-ab9f-1a83414853cf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.808776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e1f8c8b0-c4b7-4e46-83e9-2824b9718158 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:38.809992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e1f8c8b0-c4b7-4e46-83e9-2824b9718158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:38.826037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:38.827057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.827526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.827887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.829760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:38.831352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:38.833670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 195/401] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:38 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:38.839891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:38.953996 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb954c-755e-4f6e-a18d-65d8e54f7b56 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:38.964225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:38.993921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 207/402] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:38.995084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b77c6-85e2-411b-958c-3adfacc94c20 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:38.995360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b77c6-85e2-411b-958c-3adfacc94c20 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:38.995629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b77c6-85e2-411b-958c-3adfacc94c20 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:38.997072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 208/403] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:39.002902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf695d0-cb0c-4894-b9ab-59e5473034e7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.003175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf695d0-cb0c-4894-b9ab-59e5473034e7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.003440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf695d0-cb0c-4894-b9ab-59e5473034e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.013068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:39.014607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.014607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.014607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf/groups/413e3aa7b06942d69538b7804b5850ca/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.016507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=542addf9918145cbb654e539109817bf, group_id=413e3aa7b06942d69538b7804b5850ca, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:39.017994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:39.027680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-daf695d0-cb0c-4894-b9ab-59e5473034e7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:39.028899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-daf695d0-cb0c-4894-b9ab-59e5473034e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:39.034689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 196/404] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 11:51:38 2022] PUT /identity/v3/projects/542addf9918145cbb654e539109817bf/groups/413e3aa7b06942d69538b7804b5850ca/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:39.035554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.162609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 209/405] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:39.207561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf695d0-cb0c-4894-b9ab-59e5473034e7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.238250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8afbf-992a-4f86-bcea-821f6b443d0c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:39.274774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:39.275687 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.275967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.276239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.289200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:39.293559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:39.307134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:39.308063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:39.308879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:39.316727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 197/406] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:39.317249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.352403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:39.363125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf695d0-cb0c-4894-b9ab-59e5473034e7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:39.408775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:39.409700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.409975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.410243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.422239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:39.430716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:39.431684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:39.432485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 210/407] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:39.438173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.445617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a096f24-ad28-4e07-b4e4-049801671c0b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:39.515265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:39.516003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.516292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.516564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.517383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:39.517767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:39.519159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:39.538592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 198/408] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:39.545606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.575970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00b693-d709-492f-8747-658d7da1b8be None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:39.591098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:39.639555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:39.641060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.641530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.641984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.644041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:39.644621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:39.646235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:39.662128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 211/409] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:39.666542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.712102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:39.739181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618fd31-a9a6-4722-9c14-57469e31f74a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:39.803051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:39.804726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.805197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.805673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.807172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:39.808917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:39.811055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 199/410] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:39.820030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.831366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c4c6-5e0f-42c1-9fa2-a8403f36d64e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:39.872322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:39.873212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:39.873496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:39.873763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] PATH_INFO: `/v3/groups/95e9f2dfec8c4563ad4eec6800387667` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:39.878246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] RBAC: Authorizing `identity:get_group(group_id=95e9f2dfec8c4563ad4eec6800387667)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:39.879722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:39.881548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 212/411] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/groups/95e9f2dfec8c4563ad4eec6800387667 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:39.888016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:39.985112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:39.990379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf57c-0b0f-48d7-9aa6-e980e534abcf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:40.037399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:40.038270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.038550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.038823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.042609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:40.044076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:40.051969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 200/412] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:40.052707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:40.084060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:40.130008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224ee7a-1139-40f6-9551-5fc2d731e9d9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:40.170636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504c85b-5394-4654-bd73-28e536fa0f17 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:40.205725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdd8d8-977f-46ea-974b-21dcecbc1be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:40.206684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdd8d8-977f-46ea-974b-21dcecbc1be5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.206962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdd8d8-977f-46ea-974b-21dcecbc1be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.207228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdd8d8-977f-46ea-974b-21dcecbc1be5 None admin] PATH_INFO: `/v3/projects/f8b904bb5322427b8794f68069b5704c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.209902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdd8d8-977f-46ea-974b-21dcecbc1be5 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b904bb5322427b8794f68069b5704c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:40.210186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdd8d8-977f-46ea-974b-21dcecbc1be5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:40.210649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf4d4b-594c-4bf7-8a92-6f1b30a7ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:40.211540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4d4b-594c-4bf7-8a92-6f1b30a7ec68 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.211819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4d4b-594c-4bf7-8a92-6f1b30a7ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.212092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4d4b-594c-4bf7-8a92-6f1b30a7ec68 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf/groups/413e3aa7b06942d69538b7804b5850ca/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.212201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 213/413] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:39 2022] GET /identity/v3/projects/f8b904bb5322427b8794f68069b5704c => generated 344 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:40.213539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e6ea-0154-486f-a2e3-4ced340cf253 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.213818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e6ea-0154-486f-a2e3-4ced340cf253 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.214086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e6ea-0154-486f-a2e3-4ced340cf253 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.215289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 214/414] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:40.218733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0e6ea-0154-486f-a2e3-4ced340cf253 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:40.219108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf4d4b-594c-4bf7-8a92-6f1b30a7ec68 None admin] RBAC: Authorizing `identity:create_grant(project_id=542addf9918145cbb654e539109817bf, group_id=413e3aa7b06942d69538b7804b5850ca, role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:40.220839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf4d4b-594c-4bf7-8a92-6f1b30a7ec68 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:40.242890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 201/415] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 11:51:40 2022] PUT /identity/v3/projects/542addf9918145cbb654e539109817bf/groups/413e3aa7b06942d69538b7804b5850ca/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:40.244485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a084-f320-43cc-9556-9a77b376dad8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.244801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a084-f320-43cc-9556-9a77b376dad8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.245077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a084-f320-43cc-9556-9a77b376dad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.276321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0a93a084-f320-43cc-9556-9a77b376dad8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:40.277734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0a93a084-f320-43cc-9556-9a77b376dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:40.363986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 202/416] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:40.404774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93a084-f320-43cc-9556-9a77b376dad8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:40.425051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:40.463704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0e6ea-0154-486f-a2e3-4ced340cf253 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:40.478436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:40.528083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:40.529791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.530324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.530734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] PATH_INFO: `/v3/projects/f8b904bb5322427b8794f68069b5704c/groups/95e9f2dfec8c4563ad4eec6800387667/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.533606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b904bb5322427b8794f68069b5704c, group_id=95e9f2dfec8c4563ad4eec6800387667, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:40.536107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:40.544409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93a084-f320-43cc-9556-9a77b376dad8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:40.559417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 215/417] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 11:51:40 2022] PUT /identity/v3/projects/f8b904bb5322427b8794f68069b5704c/groups/95e9f2dfec8c4563ad4eec6800387667/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:51:40.589585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:40.590662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.591154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.591576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.613839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:40.622247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:40.623376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:40.624329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:40.626480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 203/418] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:40.632698 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:40.758127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cbab5-450f-47ae-8b87-b8cf9f27bcb1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:40.813414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9ef25-0f5a-43c3-8a3d-4cfba3ac28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:40.814356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9ef25-0f5a-43c3-8a3d-4cfba3ac28c0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.814775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9ef25-0f5a-43c3-8a3d-4cfba3ac28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.815212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9ef25-0f5a-43c3-8a3d-4cfba3ac28c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:40.816108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9ef25-0f5a-43c3-8a3d-4cfba3ac28c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:40.816547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9ef25-0f5a-43c3-8a3d-4cfba3ac28c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:40.818139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9ef25-0f5a-43c3-8a3d-4cfba3ac28c0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:40.827789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 216/419] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:40.832989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:40.915624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:40.944156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e07f7-7dc5-4570-95bd-170fb6938165 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:40.988291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:40.988977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:40.989258 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:40.989532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.081532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:41.083008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:41.147160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bccc25-c3fa-42ab-bdec-7276c14bfb26 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:41.147805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bccc25-c3fa-42ab-bdec-7276c14bfb26 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:41.148265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bccc25-c3fa-42ab-bdec-7276c14bfb26 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.151871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 217/420] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:41.157535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a5a3-91f1-4801-9f5b-67c4082e0a30 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:41.158115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a5a3-91f1-4801-9f5b-67c4082e0a30 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:41.158612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a5a3-91f1-4801-9f5b-67c4082e0a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.161021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:41.176370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-54f6a5a3-91f1-4801-9f5b-67c4082e0a30 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:41.177893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-54f6a5a3-91f1-4801-9f5b-67c4082e0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:41.197389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 204/421] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:41.202434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:41.211157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:41.255786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 218/422] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:41.280407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6a5a3-91f1-4801-9f5b-67c4082e0a30 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:41.405659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6a5a3-91f1-4801-9f5b-67c4082e0a30 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:41.442013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f618-b4ec-430c-8b02-58419ae748b5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:41.479168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:41.479989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:41.480270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:41.480543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.499885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:41.500519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:41.502506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:41.502506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:41.502506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.503881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:41.505360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:41.513205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:41.514061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:41.514850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:41.515449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 205/423] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:41 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:41.515516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 219/424] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:41.521932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:41.523624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:41.559298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:41.580988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:41.689498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff374bd-37e7-4a6f-97e8-4321eff174fc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:41.709441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd0e58-dad7-4e41-9cf9-a826c42c2d1d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:41.746398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:41.747256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:41.747529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:41.747805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.751669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:41.753162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:41.754818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 206/425] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:41 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:41.760607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:41.809435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:41.810130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:41.810414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:41.810690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.811464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:41.811771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:41.813212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:41.832004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 220/426] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:41.838508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:41.880271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46892a-61ed-4ab3-aade-530fe242b8d6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:41.892827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:41.920519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff13f02-e1a8-461a-9b00-695841fcf89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:41.921569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13f02-e1a8-461a-9b00-695841fcf89e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:41.922115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13f02-e1a8-461a-9b00-695841fcf89e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:41.922582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff13f02-e1a8-461a-9b00-695841fcf89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:41.923612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff13f02-e1a8-461a-9b00-695841fcf89e None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:41.924117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff13f02-e1a8-461a-9b00-695841fcf89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:41.925970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff13f02-e1a8-461a-9b00-695841fcf89e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:41.932933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 207/427] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:41 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=36180a439e5845b8b09129d2ba66c697 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:42.016090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7908930-9d11-40bf-92a2-fbf7fb667ac1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.016387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7908930-9d11-40bf-92a2-fbf7fb667ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.016552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7908930-9d11-40bf-92a2-fbf7fb667ac1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.016929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:42.019387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 208/428] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:42.023757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d830c-45d1-4b8d-9aff-4ccfb43ddfdc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.024043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d830c-45d1-4b8d-9aff-4ccfb43ddfdc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.024323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d830c-45d1-4b8d-9aff-4ccfb43ddfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.051812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-210d830c-45d1-4b8d-9aff-4ccfb43ddfdc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:42.053846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-210d830c-45d1-4b8d-9aff-4ccfb43ddfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:42.066792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74dac9-6f19-4211-b943-d186fbfd5406 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:42.113183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:42.113846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.114123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.114395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.185939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 209/429] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:42.210318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d830c-45d1-4b8d-9aff-4ccfb43ddfdc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:42.246249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:42.248132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:42.359285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:42.359709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d830c-45d1-4b8d-9aff-4ccfb43ddfdc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:42.363574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:42.387701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 221/430] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:51:42.395048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:42.412389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:42.413690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.414239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.414735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.430417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:42.441846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:42.442779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:51:42.443598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:42.446915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 210/431] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:42.452282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:42.523343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19d2c7-266f-497d-896d-8c730a2bf514 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:42.573644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:42.574523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.574801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.575071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] PATH_INFO: `/v3/projects/4768ad428ad24ba3b987e77a8d5007ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.575985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f97c-511e-4c86-94c1-84cdea05b6a3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:42.576274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=4768ad428ad24ba3b987e77a8d5007ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:42.578034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:42.581025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 222/432] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:42 2022] GET /identity/v3/projects/4768ad428ad24ba3b987e77a8d5007ee => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:42.588556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:42.617417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:42.618091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.618434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.618809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.619639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:42.620016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:42.621524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:42.631707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 211/433] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:51:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:42.638600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:42.659371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:42.692864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:42.736197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66eac0-980d-484c-b2ca-4af02f136ef6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:42.783027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:42.783909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.784184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.784452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.785683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:42.787134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:42.789156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 223/434] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:42 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:42.799725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:42.809129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585856c3-34c4-4fc9-b293-aaf86f21576c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:42.861283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:42.862011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.862287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.862554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.914423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e3853-fc1d-45b6-9e60-a61f65bd5adb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:42.931296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:42.932048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:42.933489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:42.953772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fbbc8-17e1-482a-83d9-d422cc702594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:42.954421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbbc8-17e1-482a-83d9-d422cc702594 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.954797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbbc8-17e1-482a-83d9-d422cc702594 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.955064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbbc8-17e1-482a-83d9-d422cc702594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.955906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbbc8-17e1-482a-83d9-d422cc702594 None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=4768ad428ad24ba3b987e77a8d5007ee) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:42.956209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbbc8-17e1-482a-83d9-d422cc702594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:42.957659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbbc8-17e1-482a-83d9-d422cc702594 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:42.961782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:42.971763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 224/435] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:42 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=4768ad428ad24ba3b987e77a8d5007ee&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:42.971763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8569a-504b-44c8-9643-d29b44483049 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.971763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8569a-504b-44c8-9643-d29b44483049 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.971763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8569a-504b-44c8-9643-d29b44483049 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:42.971763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 225/436] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:42.973748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f12a-6209-47b0-9e03-a1c265ad0b34 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:42.973748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f12a-6209-47b0-9e03-a1c265ad0b34 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:42.974047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f12a-6209-47b0-9e03-a1c265ad0b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.000800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8b06f12a-6209-47b0-9e03-a1c265ad0b34 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:43.002030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8b06f12a-6209-47b0-9e03-a1c265ad0b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:43.068806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 212/437] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:43.077617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.094830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 226/438] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:43.121874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f12a-6209-47b0-9e03-a1c265ad0b34 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.242628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff35418-cc2a-410b-ab60-274164c32bdf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.257564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f12a-6209-47b0-9e03-a1c265ad0b34 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.273901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:43.284516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:43.300014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.300943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.301220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.301996 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.303780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:43.305301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:43.307169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 213/439] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:43.308690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.309542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.309881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.310233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.312868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.327226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:43.335344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:43.336362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:43.341363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 227/440] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:43.343545 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.441796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699211-bf45-4a99-b63f-458dd6a17bed None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.477018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac0588-9c3f-4911-9402-ed6f2f1c6f5e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.482745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112759e9-5924-431e-a156-6d5dfda1f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.483820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112759e9-5924-431e-a156-6d5dfda1f53d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.483925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112759e9-5924-431e-a156-6d5dfda1f53d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.484134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112759e9-5924-431e-a156-6d5dfda1f53d None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.487223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112759e9-5924-431e-a156-6d5dfda1f53d None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:43.487223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112759e9-5924-431e-a156-6d5dfda1f53d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:43.488445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 214/441] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:43.489798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bb453-d492-45c1-9986-6e6091a9b287 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.490151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bb453-d492-45c1-9986-6e6091a9b287 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.490425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bb453-d492-45c1-9986-6e6091a9b287 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.496856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 215/442] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:43.496856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bb453-d492-45c1-9986-6e6091a9b287 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.519700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175eeb2-0ad5-45bd-9bb0-b8d89cc8df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.520369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175eeb2-0ad5-45bd-9bb0-b8d89cc8df0c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.520672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175eeb2-0ad5-45bd-9bb0-b8d89cc8df0c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.520947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175eeb2-0ad5-45bd-9bb0-b8d89cc8df0c None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.521742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175eeb2-0ad5-45bd-9bb0-b8d89cc8df0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:43.522169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175eeb2-0ad5-45bd-9bb0-b8d89cc8df0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:43.523446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175eeb2-0ad5-45bd-9bb0-b8d89cc8df0c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:43.532007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 228/443] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:43.533325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba006d0-0fec-4e9b-bc4f-b559ea5157f9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.533606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba006d0-0fec-4e9b-bc4f-b559ea5157f9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.533869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba006d0-0fec-4e9b-bc4f-b559ea5157f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.549912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4ba006d0-0fec-4e9b-bc4f-b559ea5157f9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:43.551197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4ba006d0-0fec-4e9b-bc4f-b559ea5157f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:43.562814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:43.576563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:43.603141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bb453-d492-45c1-9986-6e6091a9b287 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.633018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 229/444] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:43.633018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba006d0-0fec-4e9b-bc4f-b559ea5157f9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.635738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.636400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.636685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.636959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.637781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=36180a439e5845b8b09129d2ba66c697, scope.project.id=542addf9918145cbb654e539109817bf) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:43.638087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:43.639514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:43.645345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 216/445] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=542addf9918145cbb654e539109817bf&role.id=36180a439e5845b8b09129d2ba66c697 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:43.646118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.742930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba006d0-0fec-4e9b-bc4f-b559ea5157f9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.765743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732d74d-fd0b-4b1d-879b-c253c7777279 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.781111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.781770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.782050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.782332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.797868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:43.808034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.808867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.809161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.809408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.815450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:43.822542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:43.830883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:43.831810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:43.832632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 217/446] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:43.837330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.860467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:43.863582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:43.951055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806cd02-2069-4237-91c7-7604b4bc5872 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:43.986926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 230/447] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:43.989552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:43.990223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:43.990504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:43.990777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:43.992247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:43.992247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:43.992895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:43.994367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.008215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 218/448] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:44.014608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:44.069179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:44.070496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:44.108351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fb368-82c2-4d73-bf42-ba1fa22f0bf5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:44.120507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780532-8e49-46dd-aad5-6cf1c5eccafd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:44.142453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:44.143322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:44.143597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:44.143863 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] PATH_INFO: `/v3/projects/542addf9918145cbb654e539109817bf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:44.145088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=542addf9918145cbb654e539109817bf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:44.146536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.148236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 231/449] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:43 2022] GET /identity/v3/projects/542addf9918145cbb654e539109817bf => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:44.153585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:44.153813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:44.154456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:44.154734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:44.155005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:44.220406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:44.221920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.254646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591552-d5fc-40ae-9ea6-87577d7d1ed8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:44.268051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:44.283020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:44.289096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:44.289956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:44.290234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:44.290560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] PATH_INFO: `/v3/groups/413e3aa7b06942d69538b7804b5850ca` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:44.292048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] RBAC: Authorizing `identity:get_group(group_id=413e3aa7b06942d69538b7804b5850ca)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:44.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.295173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 232/450] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:44 2022] GET /identity/v3/groups/413e3aa7b06942d69538b7804b5850ca => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:44.301008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:44.319350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 219/451] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:44.324921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:44.406384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cdf27-ce6a-46b4-b9ad-d1861c97806a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:44.422995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e713967-0f5b-414b-9f73-c40ee14a0a97 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:44.441063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:44.441720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:44.441996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:44.442265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:44.443101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] RBAC: Adding query filter params (group.id=413e3aa7b06942d69538b7804b5850ca, role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=542addf9918145cbb654e539109817bf) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:44.443407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:44.444876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.463815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 233/452] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:44 2022] GET /identity/v3/role_assignments?group.id=413e3aa7b06942d69538b7804b5850ca&scope.project.id=542addf9918145cbb654e539109817bf&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:44.464022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:44.464022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:44.464022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:44.464022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] PATH_INFO: `/v3/projects/f8b904bb5322427b8794f68069b5704c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:44.464368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b904bb5322427b8794f68069b5704c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:44.464368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.464368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 220/453] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:51:44 2022] GET /identity/v3/projects/f8b904bb5322427b8794f68069b5704c => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:44.469624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:44.537441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:44.579290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641520a-a047-49af-aa50-d96597437c63 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:44.616460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870197e1-b30e-4952-845c-5892f9d0eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:44.617355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870197e1-b30e-4952-845c-5892f9d0eea6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:44.617632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870197e1-b30e-4952-845c-5892f9d0eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:44.617900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870197e1-b30e-4952-845c-5892f9d0eea6 None admin] PATH_INFO: `/v3/groups/95e9f2dfec8c4563ad4eec6800387667` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:44.619210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870197e1-b30e-4952-845c-5892f9d0eea6 None admin] RBAC: Authorizing `identity:get_group(group_id=95e9f2dfec8c4563ad4eec6800387667)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:44.620680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870197e1-b30e-4952-845c-5892f9d0eea6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.622344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 234/454] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 11:51:44 2022] GET /identity/v3/groups/95e9f2dfec8c4563ad4eec6800387667 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:44.628311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:44.647188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:44.730290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc490c-b7d4-478f-a126-8c6d1e5177d4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:44.763722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780574a-1941-4df9-960d-51fe387f406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:44.764375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780574a-1941-4df9-960d-51fe387f406f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:44.764694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780574a-1941-4df9-960d-51fe387f406f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:44.764998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780574a-1941-4df9-960d-51fe387f406f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:44.765806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780574a-1941-4df9-960d-51fe387f406f None admin] RBAC: Adding query filter params (group.id=95e9f2dfec8c4563ad4eec6800387667, role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=f8b904bb5322427b8794f68069b5704c) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:44.766114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780574a-1941-4df9-960d-51fe387f406f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:44.767532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780574a-1941-4df9-960d-51fe387f406f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:44.773721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 221/455] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 11:51:44 2022] GET /identity/v3/role_assignments?group.id=95e9f2dfec8c4563ad4eec6800387667&scope.project.id=f8b904bb5322427b8794f68069b5704c&role.id=aafa433396f14143bb549af1f2b6219b => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:47.395411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1393-40b9-48d8-a2d9-4d586f46ed6e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.395972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1393-40b9-48d8-a2d9-4d586f46ed6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.395972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1393-40b9-48d8-a2d9-4d586f46ed6e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.397356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 235/456] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:47.402697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95011-769e-4ae8-9426-2ad67d877498 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.403489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95011-769e-4ae8-9426-2ad67d877498 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.403995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95011-769e-4ae8-9426-2ad67d877498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.422032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fff95011-769e-4ae8-9426-2ad67d877498 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:47.423560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fff95011-769e-4ae8-9426-2ad67d877498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:47.516766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 222/457] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:47.560126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1393-40b9-48d8-a2d9-4d586f46ed6e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:47.674769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1393-40b9-48d8-a2d9-4d586f46ed6e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:47.704533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:47.711290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f608f-24bf-41ca-88c6-7dea98e2ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:47.712722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f608f-24bf-41ca-88c6-7dea98e2ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.713262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f608f-24bf-41ca-88c6-7dea98e2ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.713941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f608f-24bf-41ca-88c6-7dea98e2ab1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.725971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f608f-24bf-41ca-88c6-7dea98e2ab1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:47.727633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f608f-24bf-41ca-88c6-7dea98e2ab1f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-545f608f-24bf-41ca-88c6-7dea98e2ab1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:47.746834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:47.747781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:47.748606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:47.748606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:47.748606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:47.748606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:47.748606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 236/458] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:47.754061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95011-769e-4ae8-9426-2ad67d877498 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:47.769183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7cd6b-3c9b-4e6c-91e3-d0adf798d3b7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.769787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7cd6b-3c9b-4e6c-91e3-d0adf798d3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.770453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:47.771125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7cd6b-3c9b-4e6c-91e3-d0adf798d3b7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.773004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 237/459] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:47.779389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e1e80-122b-47ed-94ee-f671a4ce7c72 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.779947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e1e80-122b-47ed-94ee-f671a4ce7c72 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.780418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e1e80-122b-47ed-94ee-f671a4ce7c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.802736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e81e1e80-122b-47ed-94ee-f671a4ce7c72 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:47.805438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e81e1e80-122b-47ed-94ee-f671a4ce7c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:47.917824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 238/460] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:47.925370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c896-c916-4f46-9671-a890ebaa8c87 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.925641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c896-c916-4f46-9671-a890ebaa8c87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.925994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c896-c916-4f46-9671-a890ebaa8c87 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.927559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 239/461] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:47.934303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d7c2-ed62-49f4-b241-b1609c0f2d1e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.934659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d7c2-ed62-49f4-b241-b1609c0f2d1e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.935002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d7c2-ed62-49f4-b241-b1609c0f2d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.940182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95011-769e-4ae8-9426-2ad67d877498 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:47.965687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5756d7c2-ed62-49f4-b241-b1609c0f2d1e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:47.967464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5756d7c2-ed62-49f4-b241-b1609c0f2d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:47.984540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:47.985235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:47.985517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:47.985861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:47.986559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:47.986862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:47.988401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.005288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 223/462] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:48.005288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.068982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 240/463] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:48.068982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d7c2-ed62-49f4-b241-b1609c0f2d1e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.107075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:48.140341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:48.141693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42472aff-a930-473a-b1fb-4716b046727c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.186894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.187683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.188104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.188382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.201130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.202533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.217335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d7c2-ed62-49f4-b241-b1609c0f2d1e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:48.220447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:48.221464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:48.227266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:48.227266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:48.227266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:48.227266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:48.227266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 224/464] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:48.227266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.253899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32ed14-92c2-43bf-9d7f-784199c4849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.254614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ed14-92c2-43bf-9d7f-784199c4849f None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.254881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ed14-92c2-43bf-9d7f-784199c4849f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.255155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ed14-92c2-43bf-9d7f-784199c4849f None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.255971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ed14-92c2-43bf-9d7f-784199c4849f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.257459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ed14-92c2-43bf-9d7f-784199c4849f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.285843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 241/465] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:48 2022] POST /identity/v3/users => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:48.285843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615737-af57-428b-aa83-d9ab73ae370c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.285843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615737-af57-428b-aa83-d9ab73ae370c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.285843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615737-af57-428b-aa83-d9ab73ae370c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.288842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 242/466] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:48.289785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615737-af57-428b-aa83-d9ab73ae370c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.350890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4c12-7451-44e8-a52e-60e7e9efb9f9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.391120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:48.409010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4fd18-7a60-4c6b-9a4d-54fee5fadab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.409843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4fd18-7a60-4c6b-9a4d-54fee5fadab3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.410120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4fd18-7a60-4c6b-9a4d-54fee5fadab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.410438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4fd18-7a60-4c6b-9a4d-54fee5fadab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.422254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:48.427732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615737-af57-428b-aa83-d9ab73ae370c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.427924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4fd18-7a60-4c6b-9a4d-54fee5fadab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.429294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4fd18-7a60-4c6b-9a4d-54fee5fadab3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b3a4fd18-7a60-4c6b-9a4d-54fee5fadab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:48.455496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:48.456579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:48.458067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:48.458067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:48.458067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:48.458067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:48.462838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 225/467] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:48.462838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5c2f-66c7-4648-945b-4d10d5374db4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.462838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5c2f-66c7-4648-945b-4d10d5374db4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.462838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5c2f-66c7-4648-945b-4d10d5374db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.476602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.478828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.478828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.478828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.479298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:48.479603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.480112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-089a5c2f-66c7-4648-945b-4d10d5374db4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:48.481866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.482010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-089a5c2f-66c7-4648-945b-4d10d5374db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:48.503436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 243/468] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:48.508531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.572027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 226/469] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:48.577142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a5c2f-66c7-4648-945b-4d10d5374db4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.627383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5b42-6e51-4c88-b40a-15281a3ee191 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.665345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.666276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.667015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.667483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.668418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:48.668916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.670508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.684321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 244/470] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:48.685718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.695055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a5c2f-66c7-4648-945b-4d10d5374db4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.701928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:48.716252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:48.738171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.738894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.739176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.739448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.740194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.741666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.771773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 227/471] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:48 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:48.772938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.806864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636025db-45bd-4a4e-a5e0-600630bec8f6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.855785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ed613-2da4-412d-ad17-fe61f5a54351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.856597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed613-2da4-412d-ad17-fe61f5a54351 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.856907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed613-2da4-412d-ad17-fe61f5a54351 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.858132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed613-2da4-412d-ad17-fe61f5a54351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.880483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ed613-2da4-412d-ad17-fe61f5a54351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.882031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ed613-2da4-412d-ad17-fe61f5a54351 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-768ed613-2da4-412d-ad17-fe61f5a54351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:48.911581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:48.912485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:48.913794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:48.913794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:48.913794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:48.913794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:48.913794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 245/472] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:48.918114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0e059-a9fb-40c2-a272-0bf0f0f8e656 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.918371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0e059-a9fb-40c2-a272-0bf0f0f8e656 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.918642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0e059-a9fb-40c2-a272-0bf0f0f8e656 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.920151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 246/473] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:48.921231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0e059-a9fb-40c2-a272-0bf0f0f8e656 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:48.951044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8caf5c-f21c-4628-87e5-316c5e8e1ffa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:48.991845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19663ee-f44c-4416-8afd-3622c0e64fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:48.993093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19663ee-f44c-4416-8afd-3622c0e64fb9 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:48.993499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19663ee-f44c-4416-8afd-3622c0e64fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:48.993843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19663ee-f44c-4416-8afd-3622c0e64fb9 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:48.994621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19663ee-f44c-4416-8afd-3622c0e64fb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:48.997046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19663ee-f44c-4416-8afd-3622c0e64fb9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:49.001898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:49.026664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 228/474] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:48 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:49.033114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2dca5-a88a-4d75-8dc1-670eff3f2e3d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:49.033453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2dca5-a88a-4d75-8dc1-670eff3f2e3d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:49.033733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2dca5-a88a-4d75-8dc1-670eff3f2e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:49.042663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0e059-a9fb-40c2-a272-0bf0f0f8e656 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:49.063001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-59a2dca5-a88a-4d75-8dc1-670eff3f2e3d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:49.064717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-59a2dca5-a88a-4d75-8dc1-670eff3f2e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:49.078687 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:49.086874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:49.087605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:49.087925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:49.088234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:49.088977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:49.089281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:49.090718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:49.105263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 247/475] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:49.112189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:49.154621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 229/476] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:49.189002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2dca5-a88a-4d75-8dc1-670eff3f2e3d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:49.231302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d5630-8206-444a-a608-bad45e662f2d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:49.262959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:49.269213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:49.269827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:49.270433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:49.270915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:49.271897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:49.273657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:49.304728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 248/477] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:49 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:51:49.355161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2dca5-a88a-4d75-8dc1-670eff3f2e3d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:49.394984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:49.395723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:49.395999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:49.396263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:49.397094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:49.398512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:49.407579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.sql.core [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:51:49.407579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 11:51:49.407579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [parameters: {'id': '942cffa2c48b466ab93f8067100acccc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 11:51:49.407579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80215) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application conn.query(q) May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result.read() May 19 11:51:49.425388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return ref.to_dict() May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:51:49.426827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application next(self.gen) May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application yield resource May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application next(self.gen) May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise self.value May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application session.commit() May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:51:49.427731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.session.flush() May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application compat.raise_( May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:51:49.428579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:51:49.429476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application conn.query(q) May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result.read() May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:51:49.430289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [parameters: {'id': '942cffa2c48b466ab93f8067100acccc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:49.431107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 11:51:49.431884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:49.434369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 230/478] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 11:51:49 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:49.436820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:49.556225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf654a8-fcf8-48d7-a755-f391033eaf7f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:49.595627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6851d-05a4-40d1-8699-6474f9c17021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:49.596442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6851d-05a4-40d1-8699-6474f9c17021 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:49.596752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6851d-05a4-40d1-8699-6474f9c17021 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:49.597022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6851d-05a4-40d1-8699-6474f9c17021 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:49.608896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6851d-05a4-40d1-8699-6474f9c17021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3fb6851d-05a4-40d1-8699-6474f9c17021 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:49.617349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:49.618363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:51:49.619154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:49.623396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 249/479] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:51:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:49.624756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:49.639002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:49.738645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb82f07-19a1-4e66-8d60-5933346251db None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:49.775349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da96af-195d-4c49-b6be-8d4ced282565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:49.776021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da96af-195d-4c49-b6be-8d4ced282565 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:49.776300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da96af-195d-4c49-b6be-8d4ced282565 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:49.776572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da96af-195d-4c49-b6be-8d4ced282565 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:49.777386 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da96af-195d-4c49-b6be-8d4ced282565 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:49.777694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da96af-195d-4c49-b6be-8d4ced282565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:49.779073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da96af-195d-4c49-b6be-8d4ced282565 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:49.788394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 231/480] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:50.863765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfe8f4-8734-4a80-9ba8-c96df7f3d064 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:50.864313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfe8f4-8734-4a80-9ba8-c96df7f3d064 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:50.864313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfe8f4-8734-4a80-9ba8-c96df7f3d064 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:50.865979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 250/481] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:50.871538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5a1-abd2-4b50-9cba-cfd7b77440e1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:50.872007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5a1-abd2-4b50-9cba-cfd7b77440e1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:50.872105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5a1-abd2-4b50-9cba-cfd7b77440e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:50.891459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a33ba5a1-abd2-4b50-9cba-cfd7b77440e1 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:50.892719 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a33ba5a1-abd2-4b50-9cba-cfd7b77440e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:50.975135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 232/482] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:51.010478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfe8f4-8734-4a80-9ba8-c96df7f3d064 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:51.074954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:51.130591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfe8f4-8734-4a80-9ba8-c96df7f3d064 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:51.165431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:51.166964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:51.167445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:51.167931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:51.178699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:51.187034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:51.187941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:51.188864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:51.191618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 251/483] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:51.197352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba5a1-abd2-4b50-9cba-cfd7b77440e1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:51.199585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:51.355268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba5a1-abd2-4b50-9cba-cfd7b77440e1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:51.408384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f7c2d-7aaf-4f25-96ac-db998f692e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:51.408998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7c2d-7aaf-4f25-96ac-db998f692e47 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:51.409282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7c2d-7aaf-4f25-96ac-db998f692e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:51.409550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7c2d-7aaf-4f25-96ac-db998f692e47 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:51.410308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f7c2d-7aaf-4f25-96ac-db998f692e47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:51.410614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f7c2d-7aaf-4f25-96ac-db998f692e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:51.412008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f7c2d-7aaf-4f25-96ac-db998f692e47 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:51.426939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:51.428973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 233/484] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:51.596028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47372d64-5830-48e6-b714-7940876c71ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:51.606651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:51.647516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:51.647849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdafc4-660a-4ce1-b302-cfb4c70bc16d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:51.648126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdafc4-660a-4ce1-b302-cfb4c70bc16d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:51.648318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:51.648415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdafc4-660a-4ce1-b302-cfb4c70bc16d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:51.648595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:51.648897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:51.650003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 234/485] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:51.663296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:51.664743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:51.673082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118b22-9488-45a4-a898-bb545de44778 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:51.673404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118b22-9488-45a4-a898-bb545de44778 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:51.673642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118b22-9488-45a4-a898-bb545de44778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:51.700428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:51.701372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:51.702207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:51.702207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:51.702207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:51.702207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:51.705888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 252/486] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:51.706071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eb118b22-9488-45a4-a898-bb545de44778 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:51.707263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eb118b22-9488-45a4-a898-bb545de44778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:51.711338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:51.810040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:51.832794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 235/487] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:51:51.851379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb118b22-9488-45a4-a898-bb545de44778 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:51.881279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f091-3dbe-4ccb-a714-9ff882633317 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:51.917046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebabd9-b5b2-4cf1-99a0-56a98ded6f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:51.917764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebabd9-b5b2-4cf1-99a0-56a98ded6f61 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:51.918139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebabd9-b5b2-4cf1-99a0-56a98ded6f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:51.918522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebabd9-b5b2-4cf1-99a0-56a98ded6f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:51.919376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebabd9-b5b2-4cf1-99a0-56a98ded6f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:51.919745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebabd9-b5b2-4cf1-99a0-56a98ded6f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:51.921239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebabd9-b5b2-4cf1-99a0-56a98ded6f61 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:51.933905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 253/488] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:51:51.935478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2656c-1062-434d-ab82-2af872b681d6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:51.935853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2656c-1062-434d-ab82-2af872b681d6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:51.936224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2656c-1062-434d-ab82-2af872b681d6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:51.941994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 254/489] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:51.941994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2656c-1062-434d-ab82-2af872b681d6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:51.969254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:51.984073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb118b22-9488-45a4-a898-bb545de44778 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.023751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a011f-86bf-42cc-aab6-f997e4ac7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.025105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a011f-86bf-42cc-aab6-f997e4ac7e23 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.025644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a011f-86bf-42cc-aab6-f997e4ac7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.026071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a011f-86bf-42cc-aab6-f997e4ac7e23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.037613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a011f-86bf-42cc-aab6-f997e4ac7e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-de2a011f-86bf-42cc-aab6-f997e4ac7e23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:52.046558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:52.047476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:52.048280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:52.050770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 236/490] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:52.052285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de3009-ee83-4f76-aaad-751b99b29c6f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.052769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de3009-ee83-4f76-aaad-751b99b29c6f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.053234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de3009-ee83-4f76-aaad-751b99b29c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.061830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2656c-1062-434d-ab82-2af872b681d6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.071548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-93de3009-ee83-4f76-aaad-751b99b29c6f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:52.073064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-93de3009-ee83-4f76-aaad-751b99b29c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:52.096941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.097845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.098186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.098601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.106191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:52.107758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:51:52.124505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:52.125479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:52.126387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 255/491] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:51:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:52.127021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.130009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.160737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 237/492] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:52.161973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de3009-ee83-4f76-aaad-751b99b29c6f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.216024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.237840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960e1f-ab14-4c70-9047-c05a6e3158f9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.266933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de3009-ee83-4f76-aaad-751b99b29c6f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.273198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ccf8a-12b6-4a09-9834-c1aec938f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.273870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccf8a-12b6-4a09-9834-c1aec938f389 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.274264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccf8a-12b6-4a09-9834-c1aec938f389 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.274569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccf8a-12b6-4a09-9834-c1aec938f389 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.275322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ccf8a-12b6-4a09-9834-c1aec938f389 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:52.275627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ccf8a-12b6-4a09-9834-c1aec938f389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:52.277235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ccf8a-12b6-4a09-9834-c1aec938f389 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:52.290594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 256/493] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:52.290594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5515d-dee9-4908-af8d-0194c3a8e124 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.290594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5515d-dee9-4908-af8d-0194c3a8e124 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.290594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5515d-dee9-4908-af8d-0194c3a8e124 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.290594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 257/494] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:52.290594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5515d-dee9-4908-af8d-0194c3a8e124 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.309360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.310326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.310578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.310855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.311725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:52.312029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:52.313484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:52.351083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 238/495] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:52.352206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.397917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.422134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5515d-dee9-4908-af8d-0194c3a8e124 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.462265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841db41-1b75-4423-95cf-9ac859c03e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.463051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841db41-1b75-4423-95cf-9ac859c03e57 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.463327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841db41-1b75-4423-95cf-9ac859c03e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.463593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841db41-1b75-4423-95cf-9ac859c03e57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.463906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d747e9-2a8f-4147-a703-79fb22a8c903 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.471606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.475599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841db41-1b75-4423-95cf-9ac859c03e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f841db41-1b75-4423-95cf-9ac859c03e57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:52.483020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:52.484107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:52.485055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 258/496] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:52.485797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246216-2a0e-4fb4-959b-6401a651de84 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.486065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246216-2a0e-4fb4-959b-6401a651de84 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.486340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246216-2a0e-4fb4-959b-6401a651de84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.503494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4e246216-2a0e-4fb4-959b-6401a651de84 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:52.504706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e246216-2a0e-4fb4-959b-6401a651de84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:52.518202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.519168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.519826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.520108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.533480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:52.535695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:52.553789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:52.554640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:52.555521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:52.555521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:52.555521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:52.555521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:52.555521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 239/497] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:52.555857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.580208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 259/498] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:52.581093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e246216-2a0e-4fb4-959b-6401a651de84 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.656830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.663477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d63a8-e329-49b0-b080-83607709178b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.693394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e246216-2a0e-4fb4-959b-6401a651de84 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.697176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.697901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.698177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.698443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.722822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.730391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.731061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.731339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.731607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.732464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:52.732900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:52.734276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:52.746879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 260/499] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:52.746879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.771141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:52.772684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:52.851381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece78f4b-89a4-4b53-8be3-1f533299cea2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:52.872406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.886975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 240/500] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:52.886975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.890331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:52.890996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:52.891272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:52.891546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:52.892281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:52.892580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:52.893993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:52.905939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 261/501] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:52.906712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:52.965243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:52.993923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268263-a5cb-45a5-8d5c-23faab20f71e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.010643 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e13a1-ec71-4b2b-9516-5000c2a91376 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.028758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.029550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.029820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.030081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.041706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:53.044449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.045264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.045539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.045804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:53.049307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.050205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:53.051007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 241/502] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.051653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.056424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.057945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:53.075927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.076825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.077663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:53.077663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:53.077663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.077663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:53.077663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 262/503] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.078208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.111115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.157560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2448d25-8869-4541-91e5-9af592ca9454 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.179285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730ca0b-fba0-4be7-8960-3cd3949dfc82 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.181798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.190776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064337c-b089-48e3-b37e-57be47a7d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.191566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064337c-b089-48e3-b37e-57be47a7d845 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.191840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064337c-b089-48e3-b37e-57be47a7d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.192105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064337c-b089-48e3-b37e-57be47a7d845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.202513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064337c-b089-48e3-b37e-57be47a7d845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.203958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064337c-b089-48e3-b37e-57be47a7d845 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.213825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.214612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.214898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.215169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5064337c-b089-48e3-b37e-57be47a7d845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:53.220188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.221062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.221905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:53.221905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:53.221905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.221905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:53.221905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 242/504] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.222175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.227743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956259-42fe-4164-82a1-58421cb2cd63 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.227743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956259-42fe-4164-82a1-58421cb2cd63 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.227743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956259-42fe-4164-82a1-58421cb2cd63 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.227993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.228063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 243/505] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:53.228063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956259-42fe-4164-82a1-58421cb2cd63 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:51:53.241882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.242789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 263/506] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.243990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.327997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956259-42fe-4164-82a1-58421cb2cd63 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.335406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.343936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bad02c-4ba4-4980-b522-0fe009e9607b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.371398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.372059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.372332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.372604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.373399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:53.373702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.375083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.381655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8949a43-2add-4026-9e1f-acb1d584d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.382305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949a43-2add-4026-9e1f-acb1d584d160 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.382579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949a43-2add-4026-9e1f-acb1d584d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.382842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949a43-2add-4026-9e1f-acb1d584d160 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.382944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 244/507] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:53.383554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8949a43-2add-4026-9e1f-acb1d584d160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:53.383716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.383851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8949a43-2add-4026-9e1f-acb1d584d160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.385243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8949a43-2add-4026-9e1f-acb1d584d160 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.399068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 264/508] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:53.400231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784845-f02c-486c-bf73-226d5265e32f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.400519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784845-f02c-486c-bf73-226d5265e32f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.400816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784845-f02c-486c-bf73-226d5265e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.417537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f0784845-f02c-486c-bf73-226d5265e32f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:53.418710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f0784845-f02c-486c-bf73-226d5265e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:53.435963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.483096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd851fd-a31f-45f8-8d85-5dbb55815752 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.485339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 265/509] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:53.486234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784845-f02c-486c-bf73-226d5265e32f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.526551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.527600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.527876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.528144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.528874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:53.529178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.530556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.542724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 245/510] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:53.543537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.571617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.590158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784845-f02c-486c-bf73-226d5265e32f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.623188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.623844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.624123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.624478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.625377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:53.625680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.627105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.648406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0bf64-f03c-4b92-b64a-2f5d3031b059 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.667157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 266/511] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:53.667974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.685745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.687089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.687895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.688167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.688432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.699226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.700683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:53.717668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.718528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.719661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:53.719661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:53.719661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.719661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:53.719661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 246/512] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.720135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.771929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c4473-c36d-42d9-94e1-a3a74080bc22 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.797370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.807539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.808321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.808592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.808885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.815744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.815947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273bc1-4f1f-472f-8302-edbd47e9f58e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.817227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:51:53.831364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.832365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 267/513] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.852593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181500-d079-4067-b223-0d4349e88876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.853410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181500-d079-4067-b223-0d4349e88876 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.853692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181500-d079-4067-b223-0d4349e88876 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.853967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57181500-d079-4067-b223-0d4349e88876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.864055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57181500-d079-4067-b223-0d4349e88876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.865535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57181500-d079-4067-b223-0d4349e88876 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-57181500-d079-4067-b223-0d4349e88876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:53.882448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.883438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.884340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:53.884340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:53.884340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:53.884340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:53.884340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 247/514] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.884609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181500-d079-4067-b223-0d4349e88876 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:53.906388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:53.937206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9c401-9f5e-4717-b803-2347076503ba None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.971095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:53.971886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:53.972164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:53.972438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:53.979293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:53.980835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:53.993112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57181500-d079-4067-b223-0d4349e88876 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:51:53.995799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:53.996675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:53.997541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 268/515] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:53.998001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.025371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.031364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.032008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.032284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.032552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.098519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df12a-ca85-4e8a-9098-2eb9f0be3012 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.099668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.101166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.126734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.132042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.132725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.133008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.133279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.134039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:54.134332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.135714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.146966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 269/516] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:54.147551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.206724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 248/517] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:54.208008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.238435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.258882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd946ac-49b7-4513-a998-9cc22b0eb346 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.295018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.295722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.296000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.296259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.297145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:54.297455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.298916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.308310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab3a2-e521-4c16-b8b5-b7b44f194db0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.316223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 270/518] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:54.316836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.345577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.346232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.346509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.346775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.347495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:54.347797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.349204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.360521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 249/519] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:54.361284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.366174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.415643 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645e00-cde7-4b01-aecf-1c797572c146 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.457411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.461597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.462300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.462573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.462840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.463624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:54.463924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.465515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.466852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20cc3b-9847-4fb0-8663-79cea1a9aa10 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.483846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 271/520] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:54.484674 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.508364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.509225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.509504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.509773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.517413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.518854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:51:54.534078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:54.535181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:54.536088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 250/521] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:54.536791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.591649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286c0c3-c1c2-4e10-99db-7882e60f1c70 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.601977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.627017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.627795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.628073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.628339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.637821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5289477-028a-42df-b27c-cb8ee388c953 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.638221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.639671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:54.656891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:54.657731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:54.658586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:54.658586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:54.658586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:54.658586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:54.658586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 272/522] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:54.658909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.673406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.674051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.674323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.674587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.695878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.745318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.746783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.759844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a320d7e-9e35-419f-8462-cc7fb24ca422 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.793780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.794443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.794722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.794993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:54.795700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:54.797320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:54.817506 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 273/523] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:51:54 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:51:54.818311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.848856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 251/524] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:54.849666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:54.860900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.913535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:54.959213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3029180-a9a7-4de2-95e1-324afd15fe4d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.965381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4deb6a-6690-4926-b630-c680cca8bf50 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:54.998360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:54.999044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:54.999319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:54.999591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.000442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=7d4f967c85db412aacf6c8b441dbdeb1) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:55.000783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.002249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.003279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.004082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.004361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.004653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.005586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:55.005896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.007362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.009215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 274/525] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/role_assignments?user.id=7d4f967c85db412aacf6c8b441dbdeb1&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:55.010016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.050951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 252/526] 10.222.0.35 () {56 vars in 1139 bytes} [Thu May 19 11:51:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:55.052963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.110286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:55.132555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edf83a-3f7d-44ab-af8a-8f18fcf9e2fb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.173051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.173777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.174055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.174373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.175233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:55.175538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.177146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.193111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 275/527] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:55.193999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.200377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc347-2379-42c5-a2a2-d1aa62b987a0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.215112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:55.247636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.248843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.249219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.249546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.263096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.264963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:55.289213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:55.290371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:55.291673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:55.291673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:55.291673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:55.291673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:55.295765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 253/528] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:55.297088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.325599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248009dc-bc34-4bda-b6d8-059ab744cd67 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.366453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.367120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.367471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.367815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.384996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:55.418618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048883e6-d9e7-465c-b1a2-e40c5c17ca47 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.458470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.459695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.460121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.460930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.461380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.461851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.469422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.471215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:51:55.490693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:55.491572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:55.492413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:55.498769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 254/529] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:55.498769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.534847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:55.582094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 276/530] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:51:55.583261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.633076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:55.643183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6a432-cc48-4954-9a99-01489681c0c5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.691525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.692194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.692471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.692968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.693706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:55.694010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.695397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.699766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a9436-f981-46b0-aab0-69e5cff3bcba None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.712133 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 255/531] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:55.713417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.736520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.737350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.737695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.738069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.738940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:55.739310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.740905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.758044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 277/532] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:55.758044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.824463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:55.848811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce156-5a49-4233-9134-6d00d6c68b69 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.864969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad25ce-bf08-41d4-82e5-436be6d7e13d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:55.866640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:55.892683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.893965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.894537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.894962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.903208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:55.904096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:55.904469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:55.904885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:55.908587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.910219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.912315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:55.913907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:51:55.929022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:55.930045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:55.931005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:55.932034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 278/533] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:55.933002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:55.933783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:55.935058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:55.935880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:55.935880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:55.935880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:55.935880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:55.938756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 256/534] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:55.939691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:56.053819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3772-241c-49bc-b3e8-49812a03e098 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:56.071615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19454ae-3d39-4551-be46-a6019cc476a4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:56.090226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:56.091168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:56.091543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:56.091907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:56.092847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:56.093249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:56.094983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:56.097014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:56.113800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:56.114676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:56.114955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 257/535] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:56.115336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:56.115748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:56.116759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=9f1470011d984f45be788072525f82cb) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:56.117277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:56.118997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:56.119664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:56.126486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 279/536] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:55 2022] GET /identity/v3/role_assignments?user.id=9f1470011d984f45be788072525f82cb&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:56.127934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:56.173241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:56.301531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffff319-fbcc-4ec0-b622-af73c8b143d0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:56.340008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:56.340694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:56.341064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:56.341332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:56.342415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:56.342725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:56.344119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:56.358985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 258/537] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:56.363971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:56.378107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1e55-139f-4ac7-801c-4913aa5c6e94 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:56.415740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:56.416752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:56.417036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:56.417311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:56.418245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=8935a1ea9f94443f903d479401706473) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:56.418560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:56.420118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:56.433113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 280/538] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:56 2022] GET /identity/v3/role_assignments?user.id=8935a1ea9f94443f903d479401706473&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:56.433282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:56.479932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a573d0-bbc2-4dd8-9e1d-38e834c55a01 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:56.516560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:56.517395 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:56.517675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:56.517946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:56.525641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:56.527128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:51:56.542054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:56.542982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:56.544459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 259/539] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:56.549752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:56.672656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:56.682375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de72f0a-fda9-4fb3-b837-de5efa08eaed None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:56.718464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b941d-7642-4a8f-a2e9-dc813808a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:56.719048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b941d-7642-4a8f-a2e9-dc813808a027 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:56.719327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b941d-7642-4a8f-a2e9-dc813808a027 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:56.719596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b941d-7642-4a8f-a2e9-dc813808a027 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:56.720394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b941d-7642-4a8f-a2e9-dc813808a027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:56.720727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b941d-7642-4a8f-a2e9-dc813808a027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:56.722176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b941d-7642-4a8f-a2e9-dc813808a027 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:56.735850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 281/540] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:56.745755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:56.849235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e6f7-eaf8-46c2-8f77-9c93979e8e25 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:56.869027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:56.900177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878febe-0121-4785-917f-ae470229307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:56.900904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878febe-0121-4785-917f-ae470229307f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:56.901189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878febe-0121-4785-917f-ae470229307f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:56.901463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878febe-0121-4785-917f-ae470229307f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:56.902298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878febe-0121-4785-917f-ae470229307f None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=9bb4c7ed74924ac4ad8f759437891569) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:56.902606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878febe-0121-4785-917f-ae470229307f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:56.904035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878febe-0121-4785-917f-ae470229307f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:56.910031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 260/541] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:51:56 2022] GET /identity/v3/role_assignments?user.id=9bb4c7ed74924ac4ad8f759437891569&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:57.196415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f29b-1b5c-4caa-a604-134384a166ce None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:57.197469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f29b-1b5c-4caa-a604-134384a166ce None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:57.197986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f29b-1b5c-4caa-a604-134384a166ce None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:57.199972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 282/542] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:57.205939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450617e1-7973-4919-b532-b8ba68bd1e19 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:57.206827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450617e1-7973-4919-b532-b8ba68bd1e19 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:57.207302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450617e1-7973-4919-b532-b8ba68bd1e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:57.225396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-450617e1-7973-4919-b532-b8ba68bd1e19 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:57.226860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-450617e1-7973-4919-b532-b8ba68bd1e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:57.304721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 261/543] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:57.323083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07f29b-1b5c-4caa-a604-134384a166ce None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:57.436590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de15b-4a13-4446-bcef-24ee313c7224 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:57.437241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de15b-4a13-4446-bcef-24ee313c7224 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:57.437709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23de15b-4a13-4446-bcef-24ee313c7224 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:57.440532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 262/544] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:51:57.450218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c340f-9a1e-4557-a06f-5ee4c915d1dd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:57.450803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c340f-9a1e-4557-a06f-5ee4c915d1dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:57.451253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c340f-9a1e-4557-a06f-5ee4c915d1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:57.459578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07f29b-1b5c-4caa-a604-134384a166ce None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:57.479198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e74c340f-9a1e-4557-a06f-5ee4c915d1dd None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:57.480367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e74c340f-9a1e-4557-a06f-5ee4c915d1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:57.516710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:57.516710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:57.516710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:57.516710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:57.534072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:57.544976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:57.545862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:57.546650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:57.547473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 283/545] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:57.556274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:57.576337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:57.591382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 263/546] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:57.614977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c340f-9a1e-4557-a06f-5ee4c915d1dd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:57.669409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:57.749697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e165b07-fb1e-4050-bb01-3cdcb1addac2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:57.786799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c340f-9a1e-4557-a06f-5ee4c915d1dd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:57.799069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:57.799743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:57.800020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:57.800292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:57.801071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:57.801375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:57.803915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:57.821081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 284/547] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:57.836277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:57.851628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:57.852465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:57.852768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:57.853034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:57.879967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:57.894069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:57.895003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:57.895875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 264/548] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:57.904557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:57.980395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:58.037817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2e08f-8bb3-413d-9aa3-b8962db740ee None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.082599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:58.085065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546becd-3014-4026-a74b-488668c0b5df None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.101240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.102037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.102340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.102607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.119011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:58.120463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:58.147494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:58.148880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:58.149975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:58.149975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:58.149975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:58.149975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:58.149975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 285/549] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:58.156679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.157361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.157639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.157769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:58.157924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.158777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:58.159079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:58.160447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:58.176428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 265/550] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:58.182805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:58.342700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af9f-0287-42b8-886b-3b85a5217bbb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.374287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:58.382152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.382819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.383102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.383400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.384134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:58.384439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:58.385852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:58.391915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec282b-803f-4e16-8fac-82575cc18398 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.419023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 286/551] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:58.424499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:58.443658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.445559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.448031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.448458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.470479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:58.473365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:58.493647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:58.494649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:58.495632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:58.495632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:58.495632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:58.495632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:58.509627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 266/552] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:58.514603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:58.539991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:58.642865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76efc3-cf14-4816-8562-0e7c9777743d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.690022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389975c-dae2-4918-af22-f9b7712c1f02 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.706617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.707426 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.707701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.707971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.724831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:58.726334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:51:58.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:58.750759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:58.751965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 287/553] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:51:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:58.758595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:58.761445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.762118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.762397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.762760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.763489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:58.763793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:58.765219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:58.788600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 267/554] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:58.794706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:58.836010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:58.912432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:58.930545 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb9c96-5309-4af1-91ea-b6bfcd92a774 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.949629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dec05-5db2-49b1-8b1c-dfe0899981f3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:58.976253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee35cbc-12cb-410e-8fd7-e2c194d17722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.977040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee35cbc-12cb-410e-8fd7-e2c194d17722 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.977585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee35cbc-12cb-410e-8fd7-e2c194d17722 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.977832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee35cbc-12cb-410e-8fd7-e2c194d17722 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.978885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee35cbc-12cb-410e-8fd7-e2c194d17722 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:58.979114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee35cbc-12cb-410e-8fd7-e2c194d17722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:58.980618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee35cbc-12cb-410e-8fd7-e2c194d17722 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:58.990237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442b1b-75a8-4719-8eb2-aebc84d1e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:58.991345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442b1b-75a8-4719-8eb2-aebc84d1e83d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:58.991766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442b1b-75a8-4719-8eb2-aebc84d1e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:58.992174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442b1b-75a8-4719-8eb2-aebc84d1e83d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:58.999932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 288/555] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 11:51:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:59.000233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d442b1b-75a8-4719-8eb2-aebc84d1e83d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:59.001530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f220d-a819-4bfa-9766-b0d3d50832a8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.001904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f220d-a819-4bfa-9766-b0d3d50832a8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.002179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d442b1b-75a8-4719-8eb2-aebc84d1e83d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:59.002338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f220d-a819-4bfa-9766-b0d3d50832a8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.007828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 289/556] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:59.007828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f220d-a819-4bfa-9766-b0d3d50832a8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5d442b1b-75a8-4719-8eb2-aebc84d1e83d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:51:59.022430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:59.023469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:51:59.024941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:59.027823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 268/557] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:51:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:51:59.029273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7600-1f3d-4e85-8a3d-224e99dbe7e6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.029734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7600-1f3d-4e85-8a3d-224e99dbe7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.030173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7600-1f3d-4e85-8a3d-224e99dbe7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.048924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8e5b7600-1f3d-4e85-8a3d-224e99dbe7e6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:59.050502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8e5b7600-1f3d-4e85-8a3d-224e99dbe7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:59.128848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f220d-a819-4bfa-9766-b0d3d50832a8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.129163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 269/558] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:59.130242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7600-1f3d-4e85-8a3d-224e99dbe7e6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.133129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.162918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.163601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.163882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.164149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.214781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.240202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:59.241775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:59.254764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7600-1f3d-4e85-8a3d-224e99dbe7e6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.292029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cbd25-c83c-44c8-99a4-f8eadc275ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.293083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cbd25-c83c-44c8-99a4-f8eadc275ffa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.293572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cbd25-c83c-44c8-99a4-f8eadc275ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.293846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cbd25-c83c-44c8-99a4-f8eadc275ffa None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.294679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cbd25-c83c-44c8-99a4-f8eadc275ffa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:59.294984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cbd25-c83c-44c8-99a4-f8eadc275ffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:59.296402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cbd25-c83c-44c8-99a4-f8eadc275ffa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:59.317958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 270/559] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:59.320483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c97464-54ab-411f-83cd-43a7b490ec74 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.321099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c97464-54ab-411f-83cd-43a7b490ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.321792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c97464-54ab-411f-83cd-43a7b490ec74 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.323465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 271/560] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:59.324349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c97464-54ab-411f-83cd-43a7b490ec74 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.359682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 290/561] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:51:59.360576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.363158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.437990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c97464-54ab-411f-83cd-43a7b490ec74 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.460241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.470379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8b26-501b-49b7-bd7c-f3093e95861c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.475992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64685d82-d85d-4c39-b5d3-1d18913e2f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.476817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685d82-d85d-4c39-b5d3-1d18913e2f43 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.477131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685d82-d85d-4c39-b5d3-1d18913e2f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.477407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64685d82-d85d-4c39-b5d3-1d18913e2f43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.487871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64685d82-d85d-4c39-b5d3-1d18913e2f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-64685d82-d85d-4c39-b5d3-1d18913e2f43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:59.496037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:59.497063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:59.497949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:59.505120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 272/562] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:59.505120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e982-d6d3-4b59-aacf-2227ce0c38cf None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.505120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e982-d6d3-4b59-aacf-2227ce0c38cf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.505120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e982-d6d3-4b59-aacf-2227ce0c38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.511677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.512478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.512789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.513061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.522308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-73f5e982-d6d3-4b59-aacf-2227ce0c38cf None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:59.523505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-73f5e982-d6d3-4b59-aacf-2227ce0c38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:59.524531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:59.526122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:59.544878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:59.545927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:59.546822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:59.546822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:59.546822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:59.546822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:59.546822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 291/563] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:59.547388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.594105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 273/564] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:59.594947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e982-d6d3-4b59-aacf-2227ce0c38cf None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.612508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.657772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116e700-12e1-421c-9e81-83be1a61e9ad None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.690270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d994874-5118-4153-b241-5ecdb91a0f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.690995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994874-5118-4153-b241-5ecdb91a0f49 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.691275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994874-5118-4153-b241-5ecdb91a0f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.691576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994874-5118-4153-b241-5ecdb91a0f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.693403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e982-d6d3-4b59-aacf-2227ce0c38cf None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.701942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d994874-5118-4153-b241-5ecdb91a0f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:59.703404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d994874-5118-4153-b241-5ecdb91a0f49 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:59.703728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8d994874-5118-4153-b241-5ecdb91a0f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:51:59.720740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:59.721730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:59.722637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:51:59.722637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:51:59.722637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:51:59.722637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:51:59.722637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 292/565] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:59.723256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687412-4d94-4d69-b66e-f515846c1715 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.723537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687412-4d94-4d69-b66e-f515846c1715 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.723806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76687412-4d94-4d69-b66e-f515846c1715 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.725066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 293/566] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:51:59.725751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76687412-4d94-4d69-b66e-f515846c1715 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.734323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.735000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.735273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.735540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.736276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:59.736574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:59.737949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:59.750634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 274/567] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:59.750634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.829924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76687412-4d94-4d69-b66e-f515846c1715 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.836796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.843845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eac1f-59c4-4380-8816-2c723882a3c9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.863839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.864487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.864788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.865053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.865768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:51:59.866064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:51:59.867442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:51:59.876524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0da53-e23e-4331-9bd7-b44e0e659a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:51:59.877337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0da53-e23e-4331-9bd7-b44e0e659a14 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.877615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0da53-e23e-4331-9bd7-b44e0e659a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.877882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0da53-e23e-4331-9bd7-b44e0e659a14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.878242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 294/568] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:51:59.879013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:51:59.894138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0da53-e23e-4331-9bd7-b44e0e659a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-81d0da53-e23e-4331-9bd7-b44e0e659a14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:51:59.901891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:51:59.902975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:51:59.903821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 275/569] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:51:59.904529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11f53-0a76-471c-8a71-0275310fd782 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:51:59.904529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11f53-0a76-471c-8a71-0275310fd782 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:51:59.905422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11f53-0a76-471c-8a71-0275310fd782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:51:59.921104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5da11f53-0a76-471c-8a71-0275310fd782 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:51:59.922264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5da11f53-0a76-471c-8a71-0275310fd782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:51:59.948101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:51:59.981463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4811b-d640-4723-b092-c0c944cfbda1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:51:59.987837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 276/570] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:51:59.988657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da11f53-0a76-471c-8a71-0275310fd782 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.014964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.015600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.015915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.016184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.016939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:00.017244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.018600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.030660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 295/571] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:00.031347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.057904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.091065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da11f53-0a76-471c-8a71-0275310fd782 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.124013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.125106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.125381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.125648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.130238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd33e4-7157-4b43-9271-8ece627f7e52 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.135407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.136902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:00.154316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:00.155536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:00.156435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:00.156435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:00.156435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:00.156435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:00.156435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 277/572] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:00.156765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.169095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.169888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.170163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.170429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.172077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.177354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.178792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:00.192889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:00.193955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:00.195242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:00.198778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 296/573] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:00.199476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.257262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ff22-8a5d-4522-9c42-3413a227a8bd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.292921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.293698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.294646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.294920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.295252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.296025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:00.296671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.297734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.305619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 278/574] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:00.306399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.311694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885725-b5b1-403f-8ef7-f2a98d425d8c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.345215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.346004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.346278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.346546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.356464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:00.364066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:00.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 297/575] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:00.366715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.391977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.417034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114a4e-9cae-4899-a94c-d1b2d6d6aaee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.450275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.451099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.451267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.451540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.459149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.460622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.466944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f9f0-358e-40ca-89b3-c182113a30da None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:00.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:00.475702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:00.476590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 279/576] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:00.477214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.514641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.515311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.515585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.515848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.516573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:00.516905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.518281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.530501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 298/577] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:00.531486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.541561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.578079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6751fd-30a7-45f4-be0c-bf38de00a232 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.612336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.612982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.613292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.613566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.614451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:00.614752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.616182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.619044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.629376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 280/578] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:00.630187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.648066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf605df-0f8f-492a-a86c-96564a8b6445 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.682903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.683696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.683999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.684269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.694753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.696251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:00.713070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:00.714122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:00.719686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:00.719686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:00.719686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:00.719686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:00.719686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 299/579] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:00.719686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.739297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e23ab9-ffdc-4022-b052-bd8a17c5f75b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.773773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.774469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.774759 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.775010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.775138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.775747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:00.776047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.777578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.785574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 281/580] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:00.786366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.817879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2a2d-ae34-452b-899f-6297fdba2620 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.842642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:00.850404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.851049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.851328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.851594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.852399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:00.852737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.854167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.866219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 300/581] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:00.866804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.891507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec999-5ebc-4aab-afc6-e1edac204cf4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.927660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:00.928452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:00.928761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:00.929038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:00.937154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:00.938749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:00.952900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:00.953907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 282/582] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:00.954901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:00.968699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4edc-3abe-4a64-b4f7-073686a95ae5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:00.986487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.003666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.004565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.004878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.005151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/7d4f967c85db412aacf6c8b441dbdeb1/roles/7e8c2c66c0d84397b4dec3d68ef8105c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.019538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=7d4f967c85db412aacf6c8b441dbdeb1, role_id=7e8c2c66c0d84397b4dec3d68ef8105c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.021015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.035101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 301/583] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:00 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/7d4f967c85db412aacf6c8b441dbdeb1/roles/7e8c2c66c0d84397b4dec3d68ef8105c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:52:01.036224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.058975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f487c-9fb9-4fb3-a496-30b35cffb63b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.080825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.106568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.107250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.107513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.107782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.108506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:01.108836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.110219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.128004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 283/584] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:01.128004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.166885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef46f7d-e6eb-421b-987a-a605048fca45 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.203812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.204749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.205029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.205294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.217244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.219221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.239055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4ecb8-55bd-4dd9-a03c-d08880515107 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:01.239348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:01.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:01.241130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:01.241130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:01.241130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:01.241130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:01.243248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 302/585] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:01.244244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.273055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.277310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.277997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.278308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.278573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.279509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=aa37bb31a4fa42d5937b70c993a994fe) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:01.280004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.281341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.288719 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 284/586] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/role_assignments?user.id=aa37bb31a4fa42d5937b70c993a994fe&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:01.288719 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.339442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.363162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1ea8b-a092-4ca5-b52c-dcfbfdd01081 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.401047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.402468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.402923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.403390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.404300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd171-4bca-4aa9-983c-a6d48b91f838 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.404669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:01.405149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.406875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.427182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 303/587] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:01.428407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.448917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.449504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.449822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.450095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.458698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.460307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:01.478248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:01.479203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:52:01.480131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:01.484038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 285/588] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:01.484937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.519990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.543917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836b39-ebd6-4baa-8d34-54b05777ffcf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.579414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.580324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.580802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.581236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.582097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:01.582540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.584066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf256-2c81-439a-a72b-91a1c4e6d491 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.591827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.597059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 304/589] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:01.597910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.632358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.634702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.634702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.634702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.647625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.649170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:01.674840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:01.675935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:01.676862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:01.676862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:01.676862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:01.676862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:01.680717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 286/590] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:01.682032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.720770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5582a-282a-48fe-b535-0fd891383a16 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.756146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.757202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.757675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.758134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.759249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:01.759820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.761480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.770689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.782616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 305/591] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:01.783736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.792716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5a31-a9d4-4d8f-9a21-95e38ff75b6e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.836207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.837972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.838454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.838940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.849505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.851242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:01.873396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:01.874377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:52:01.875325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:01.882902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 287/592] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:01.882902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.899182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:01.908304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79fb74-590f-40eb-a7c5-7f1e6c69efc7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:01.943192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:01.943932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:01.944297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:01.944663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:01.945435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:01.945830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:01.947339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:01.963592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 306/593] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:01.964954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:01.990735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfea08a-6a27-4148-a9c9-4e801005e92f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.021315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:02.027268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.028549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.029082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.029590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.041513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.043404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:02.062883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:02.063830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:02.064746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:02.064746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:02.064746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:02.064746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:02.071147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3960b9-a540-4b85-9b53-058b7d074b89 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.071646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 288/594] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:02.072813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.105035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.105698 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.105990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.106293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.107068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:02.107364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.108818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.131515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 307/595] 10.222.0.35 () {56 vars in 1139 bytes} [Thu May 19 11:52:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:02.132404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.145486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:02.186471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216b1a1-0067-4c15-84a3-c31d21c71120 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.234012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.235213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.235822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.236233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.239760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85deb68f-c022-475f-988a-d38f605800b9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.245475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.247095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.260305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:02.272931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:02.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:02.274763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:02.277314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 289/596] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:02.278301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.289326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.290463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.291294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.292208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.293201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:02.294055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.296402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.312179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 308/597] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:02.317675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.417364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79996414-d5d1-46d1-b7d3-a6c77669abe0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.430850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c75db-e5d8-47d0-a3c3-b403f4f94b78 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.445530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:02.455276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.456351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.456878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.457366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.468730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.470966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.474226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.474964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.475234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.475505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.476289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:02.476592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.478122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:02.491272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:02.492217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:02.493204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:02.493204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:02.493204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:02.493204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:02.499551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 309/599] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:02.499551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.499782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 290/599] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:02.500417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.541392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:02.620106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e84f9-267d-4047-a117-eece62edbd2c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.626995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92750a7a-00a3-474a-bdf3-61f5d2717571 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.659156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.660044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.660435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.660707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/9f1470011d984f45be788072525f82cb/roles/7e8c2c66c0d84397b4dec3d68ef8105c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.667302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.668356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.668918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.669387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.676996 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=9f1470011d984f45be788072525f82cb, role_id=7e8c2c66c0d84397b4dec3d68ef8105c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.677459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.678428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.679391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:02.695626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:02.696608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:02.697864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:02.704841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 291/601] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:02 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/9f1470011d984f45be788072525f82cb/roles/7e8c2c66c0d84397b4dec3d68ef8105c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:52:02.704841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.705465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 310/601] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:02.709918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.764618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:02.889491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:02.895729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204aa9-8e01-4285-a38f-921630354f5b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.933663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101209b-267a-440f-b3e7-65e5b4345da2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:02.934861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.935639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.936017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.936384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.937328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:02.937734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.939646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:02.954192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 311/602] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:02.960214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:02.990844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:02.991791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:02.992415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:02.993295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:02.994421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:02.994880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:02.997217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:03.012557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 292/603] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:03.019041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:03.096763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730dbb-47cb-4b30-8159-1ca7c156ce1c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:03.136279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a9d5d-fdfe-445b-acb7-cfbe7b05aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:03.137271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9d5d-fdfe-445b-acb7-cfbe7b05aed3 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.137552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9d5d-fdfe-445b-acb7-cfbe7b05aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.138150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9d5d-fdfe-445b-acb7-cfbe7b05aed3 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/8935a1ea9f94443f903d479401706473/roles/7e8c2c66c0d84397b4dec3d68ef8105c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.156299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a9d5d-fdfe-445b-acb7-cfbe7b05aed3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=8935a1ea9f94443f903d479401706473, role_id=7e8c2c66c0d84397b4dec3d68ef8105c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:03.157745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a9d5d-fdfe-445b-acb7-cfbe7b05aed3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:03.176669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 312/604] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:02 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/8935a1ea9f94443f903d479401706473/roles/7e8c2c66c0d84397b4dec3d68ef8105c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:52:03.248091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:03.266666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54509e-a822-43d6-9193-863b28986c5a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:03.319290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:03.320262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.320697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.321064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.334899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:03.336592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:03.356612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:03.358596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:03.360106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:03.360546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 293/605] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:03.368007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:03.368591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b209d-8875-4ea4-a3c1-665706a7503a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.368906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b209d-8875-4ea4-a3c1-665706a7503a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.371908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b209d-8875-4ea4-a3c1-665706a7503a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.371908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 313/606] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:03.376903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230c65-3514-4441-a053-2a815b1046af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.377117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230c65-3514-4441-a053-2a815b1046af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.377393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230c65-3514-4441-a053-2a815b1046af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.388813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:03.413327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-35230c65-3514-4441-a053-2a815b1046af None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:03.418968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35230c65-3514-4441-a053-2a815b1046af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:03.500577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752cb25-0868-45f0-8ecc-dfb1e2f8c31e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:03.542497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:03.543306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.544747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.545120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.546057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:03.547232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:03.549328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:03.554815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 314/607] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:52:03.566050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 294/608] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:03.571403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35230c65-3514-4441-a053-2a815b1046af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:03.583009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:03.606877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:03.715819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8068d6-bcc3-43f7-8db7-9feb992e1302 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:03.765813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6cf0e-32fb-4b9f-b1c2-62975d563488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:03.766898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6cf0e-32fb-4b9f-b1c2-62975d563488 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.767332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6cf0e-32fb-4b9f-b1c2-62975d563488 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.767753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6cf0e-32fb-4b9f-b1c2-62975d563488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.768084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35230c65-3514-4441-a053-2a815b1046af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:03.779818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6cf0e-32fb-4b9f-b1c2-62975d563488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-39a6cf0e-32fb-4b9f-b1c2-62975d563488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:03.788619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:03.789934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:03.791304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:03.793470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 295/609] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:03.794994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e0f2e-7566-418b-ab0f-051d47d58b30 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.795470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e0f2e-7566-418b-ab0f-051d47d58b30 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.795894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e0f2e-7566-418b-ab0f-051d47d58b30 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.797353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 296/610] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:03.802347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e0f2e-7566-418b-ab0f-051d47d58b30 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:03.813098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0a35-3610-4004-84f4-61c054079f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:03.814194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0a35-3610-4004-84f4-61c054079f36 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.814572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0a35-3610-4004-84f4-61c054079f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.814944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0a35-3610-4004-84f4-61c054079f36 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/9bb4c7ed74924ac4ad8f759437891569/roles/7e8c2c66c0d84397b4dec3d68ef8105c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.818821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:03.836625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a0a35-3610-4004-84f4-61c054079f36 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=9bb4c7ed74924ac4ad8f759437891569, role_id=7e8c2c66c0d84397b4dec3d68ef8105c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:03.838533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a0a35-3610-4004-84f4-61c054079f36 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:03.857237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 315/611] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:03 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/9bb4c7ed74924ac4ad8f759437891569/roles/7e8c2c66c0d84397b4dec3d68ef8105c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:52:03.859573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5edb7-b95f-4cc0-a0ac-8f7f1f9b778e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.859996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5edb7-b95f-4cc0-a0ac-8f7f1f9b778e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.860402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5edb7-b95f-4cc0-a0ac-8f7f1f9b778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.880738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-85a5edb7-b95f-4cc0-a0ac-8f7f1f9b778e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:03.882259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-85a5edb7-b95f-4cc0-a0ac-8f7f1f9b778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:03.890193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:03.940939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e0f2e-7566-418b-ab0f-051d47d58b30 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:03.962477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 316/612] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:03.982271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:03.983002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:03.983341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:03.983621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:03.984402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:03.984786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:03.986200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:03.988312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5edb7-b95f-4cc0-a0ac-8f7f1f9b778e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:03.997635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 297/613] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:04.002513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:04.159041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5edb7-b95f-4cc0-a0ac-8f7f1f9b778e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:04.186468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:04.202544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf16d-2952-4943-bfdd-9189c4975447 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:04.211799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:04.212618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:04.212910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:04.213188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:04.229568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:04.237070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:04.239773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:04.240995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:04.241834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:04.248721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 317/614] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:04.251924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:04.252275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:04.253345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:04.253836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:04.254314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:04.266443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:04.268224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:04.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:04.301812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:04.302717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:04.302717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:04.302717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:04.302717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:04.305730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 298/615] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:04.311730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:04.416877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1231fa7-9129-40da-82d6-cf0af9af34b8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:04.464268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:04.465605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:04.467782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:04.468323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:04.469587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:04.470895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:04.472790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:04.490704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 318/616] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:04.507902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:04.524770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105e9e5-ea95-4bfe-853a-10cff7ce18d8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:04.573022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:04.582319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:04.583139 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:04.583523 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:04.583926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:04.584773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:04.587387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:04.588843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:04.613815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 299/617] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:04.617537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:04.674745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36111-1a96-42ca-b7e2-d08a8f5ea590 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:04.680965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:04.726846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:04.727654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:04.727938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:04.728210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:04.748166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:04.749604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:04.786996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:04.787972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:04.797441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:04.797441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:04.797441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:04.797441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:04.797441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 319/618] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:04.797722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a05cb-4e3a-4f31-ac3a-c2935405d092 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:04.801858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:04.837559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:04.838356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:04.838634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:04.838978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:04.855489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:04.856992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:04.883613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:04.884834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:04.886005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:04.895852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 300/619] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:52:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:04.900837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.012344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330522-e217-4f3a-babe-31c40647445d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.013918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:05.045014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:05.050522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3c4ef-cfab-4834-b02a-00bac3543c55 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.062813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.063573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.063917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.064251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.065198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:05.065587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:05.067077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:05.100333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 301/620] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:52:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:05.102572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.103420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.103859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.104281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.105183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:05.106172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.106635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:05.108230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:05.134456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 320/621] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:05.139697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.237053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797797c-62a3-43d7-bfdc-564a8c68df7d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.276216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f4f39-5a84-4f19-8bda-de0314870b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.281220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f4f39-5a84-4f19-8bda-de0314870b4f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.281541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f4f39-5a84-4f19-8bda-de0314870b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.281793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f4f39-5a84-4f19-8bda-de0314870b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.321177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:05.354781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c133d-ed1a-4e15-8c40-6f5419ddf75e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.363742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f4f39-5a84-4f19-8bda-de0314870b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:05.365552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f4f39-5a84-4f19-8bda-de0314870b4f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:05.443591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1d97-cba7-44fb-9a33-2f8fc979cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.444391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1d97-cba7-44fb-9a33-2f8fc979cc81 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.444693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1d97-cba7-44fb-9a33-2f8fc979cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.444969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1d97-cba7-44fb-9a33-2f8fc979cc81 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.452633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1d97-cba7-44fb-9a33-2f8fc979cc81 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:05.454145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1d97-cba7-44fb-9a33-2f8fc979cc81 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9b7f1d97-cba7-44fb-9a33-2f8fc979cc81 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:05.472659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:05.473635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 321/622] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673584-50d7-4559-b595-e560c5586b2d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.474600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673584-50d7-4559-b595-e560c5586b2d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.475314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673584-50d7-4559-b595-e560c5586b2d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.477691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 322/623] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:05.478724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52673584-50d7-4559-b595-e560c5586b2d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.481658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 302/624] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:52:05.483344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e630b92-55fb-41f7-b81f-452c567157c3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.483344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e630b92-55fb-41f7-b81f-452c567157c3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.483571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e630b92-55fb-41f7-b81f-452c567157c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.490682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:05.500220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0e630b92-55fb-41f7-b81f-452c567157c3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:05.501445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0e630b92-55fb-41f7-b81f-452c567157c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:05.565329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:05.584738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 303/625] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:05.585615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e630b92-55fb-41f7-b81f-452c567157c3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.623841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52673584-50d7-4559-b595-e560c5586b2d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.661333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.662203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.662641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.663012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.663949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:05.664385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:05.666341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:05.684476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 323/626] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:05.685550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.720826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e630b92-55fb-41f7-b81f-452c567157c3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.757742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.758593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.758874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.759147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.762447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:05.769657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:05.771118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:05.788696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:05.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:05.790895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:05.790895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:05.790895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:05.790895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:05.790895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 304/627] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:05.791193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.813137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973ab3b-c2c1-4efd-a1b5-13714432c6a6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.840587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:05.848985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e87239-7b3f-4d3e-91cf-8fb63e046719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.849784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87239-7b3f-4d3e-91cf-8fb63e046719 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.850061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87239-7b3f-4d3e-91cf-8fb63e046719 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.850328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87239-7b3f-4d3e-91cf-8fb63e046719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.862006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e87239-7b3f-4d3e-91cf-8fb63e046719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-77e87239-7b3f-4d3e-91cf-8fb63e046719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:05.870576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:05.871548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 324/628] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:05.877990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab808d-8c13-4ae5-945c-c96bec59a1e6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.878755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab808d-8c13-4ae5-945c-c96bec59a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.878755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab808d-8c13-4ae5-945c-c96bec59a1e6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.878755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 325/629] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:05.878755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab808d-8c13-4ae5-945c-c96bec59a1e6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.905491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c0c3e-ed2d-411e-b134-495d4318abf3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:05.941267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:05.942057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:05.942333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:05.942601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:05.952729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:05.954164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:05.972049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:05.973384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:05.974541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:05.974541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:05.974541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:05.974541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:05.974541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 305/630] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:05.974541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:05.988548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab808d-8c13-4ae5-945c-c96bec59a1e6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.016324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.026369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1c28-3f3d-498a-b4f2-3fd7f763165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.027028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1c28-3f3d-498a-b4f2-3fd7f763165b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.027304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1c28-3f3d-498a-b4f2-3fd7f763165b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.027571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1c28-3f3d-498a-b4f2-3fd7f763165b None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.028400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1c28-3f3d-498a-b4f2-3fd7f763165b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:06.028723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1c28-3f3d-498a-b4f2-3fd7f763165b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.030195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1c28-3f3d-498a-b4f2-3fd7f763165b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.043192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 326/631] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:06.044422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d825752-d04d-46ae-a136-7783570ae702 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.044714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d825752-d04d-46ae-a136-7783570ae702 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.044991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d825752-d04d-46ae-a136-7783570ae702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.062712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2d825752-d04d-46ae-a136-7783570ae702 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:06.063895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2d825752-d04d-46ae-a136-7783570ae702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:06.081943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.089103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda47915-c22d-4087-b34b-5590102cfc0a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.126824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.127430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.127704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.127969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.128847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:06.129252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.130617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.140824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 327/632] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:06.140824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d825752-d04d-46ae-a136-7783570ae702 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.144610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 306/633] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:06.145453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.249137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d825752-d04d-46ae-a136-7783570ae702 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.255593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194ff89-255d-43ee-8b7c-36a7fb43e410 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.267376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.287777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.288441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.288755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.289035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.289793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:06.290102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.291051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.291814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.291964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.292091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.292346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.302079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.308311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 328/634] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:06.308311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.308518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:06.323958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:06.324990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:06.325871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 307/635] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:06.326359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.345248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.428356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0be9fe-6a13-45df-8496-9a2cb5fc44dc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.432858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d71210-dd81-4829-af11-38b012b3627d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.462679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.463453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.463733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.464009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.466618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.467459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.467689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.467958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.474745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.476213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.477927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:06.485603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:06.486569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:06.487416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 308/636] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:06.488118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:06.493236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:06.494173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:06.495146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:06.495146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:06.495146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:06.495146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:06.495146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 329/637] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:06.495417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.523972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.575392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.597543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aeab0-b68d-454d-8bd3-07f963c8266f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.599825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9908a5d-a2f2-481d-8aa1-0ca782326c03 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.631504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6daa0-4abc-4b4e-93b4-3d744fb9bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.632166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6daa0-4abc-4b4e-93b4-3d744fb9bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.632446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6daa0-4abc-4b4e-93b4-3d744fb9bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.632747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6daa0-4abc-4b4e-93b4-3d744fb9bdfa None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.633345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.633823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6daa0-4abc-4b4e-93b4-3d744fb9bdfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:06.634146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.634241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6daa0-4abc-4b4e-93b4-3d744fb9bdfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.634425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.634699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.635592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6daa0-4abc-4b4e-93b4-3d744fb9bdfa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.641575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.643020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.649493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 330/638] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:06.650821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cc24a-9659-4058-a912-236db9007ca4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.651108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cc24a-9659-4058-a912-236db9007ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.651384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cc24a-9659-4058-a912-236db9007ca4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.652593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 331/639] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:06.653296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cc24a-9659-4058-a912-236db9007ca4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:06.662882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:06.663865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 309/640] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:06.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.743662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.756786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cc24a-9659-4058-a912-236db9007ca4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.764115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfd13-3e11-497a-8db9-dd1263c1ce41 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.790839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.791501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.791774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.792043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.792828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:06.793129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.794512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.797844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73d52-ced4-42e4-9a0c-6c4b39467a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.798495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73d52-ced4-42e4-9a0c-6c4b39467a2a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.798772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73d52-ced4-42e4-9a0c-6c4b39467a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.799037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73d52-ced4-42e4-9a0c-6c4b39467a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.799742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73d52-ced4-42e4-9a0c-6c4b39467a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:06.800039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73d52-ced4-42e4-9a0c-6c4b39467a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.801408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73d52-ced4-42e4-9a0c-6c4b39467a2a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.802583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 332/641] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:06.803359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.804303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:06.814731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 310/642] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:06.815837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a9d8-a403-4cc8-affe-70a9cd82bd5b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.816122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a9d8-a403-4cc8-affe-70a9cd82bd5b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.816403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a9d8-a403-4cc8-affe-70a9cd82bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.833701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f698a9d8-a403-4cc8-affe-70a9cd82bd5b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:06.834882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f698a9d8-a403-4cc8-affe-70a9cd82bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:06.901743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 311/643] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:06.902548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617dd4-7f49-4d92-b228-dc6b171d6bea None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:06.902907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698a9d8-a403-4cc8-affe-70a9cd82bd5b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.937094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:06.937743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:06.938016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:06.938282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:06.939105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=7d4f967c85db412aacf6c8b441dbdeb1) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:06.939411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:06.940856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:06.946620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 333/644] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/role_assignments?user.id=7d4f967c85db412aacf6c8b441dbdeb1&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:06.947378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:06.965110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.019062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698a9d8-a403-4cc8-affe-70a9cd82bd5b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.049028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.058907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.059942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.060226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.060542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.061379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:07.061672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.063143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.068840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57994fb5-7eb9-4329-9686-b1b8a8a54df0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.080522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 312/645] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:07.080522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.113020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.113826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.114104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.114373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.126673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.128158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:07.148791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:07.149717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:07.150746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:07.150746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:07.150746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:07.150746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:07.152779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 334/646] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:07.153937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.188747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612050-7efc-4101-afce-b20c96fc82b3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.224343 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.225241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.225527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.225797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.227815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.234311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.235765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:07.250381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:07.251354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 313/647] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:07.252311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.271964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325a950-af9b-4e1b-a777-d132bec74020 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.301462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.313531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.314560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.315223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.315503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.326460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:07.334381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:07.335323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:07.336217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 335/648] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:07.337764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.364112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfbfe-a72a-41e8-bed7-2b98d5e28228 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.400339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.401438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.401814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.402100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/aa37bb31a4fa42d5937b70c993a994fe/roles/7e8c2c66c0d84397b4dec3d68ef8105c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.418388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=aa37bb31a4fa42d5937b70c993a994fe, role_id=7e8c2c66c0d84397b4dec3d68ef8105c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.419944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.444669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 314/649] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:07 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/aa37bb31a4fa42d5937b70c993a994fe/roles/7e8c2c66c0d84397b4dec3d68ef8105c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:52:07.444669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.456994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003597-910f-4d13-afd6-0ad82c3fc558 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.485626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.498958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.504910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.505271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.505616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.506456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:07.506878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.508475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.524281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 336/650] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:07.525319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.576857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.584083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b6ee-979a-475d-bf90-dba74feb3f1b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.631003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.631948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.632408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.633053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.634163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:07.634624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.636239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.649516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b7140-f714-4791-a8cf-0175740979cb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.661134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 315/651] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:07.661134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.687942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.688608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.688966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.689238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.689990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:07.690290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.691670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.703750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 337/652] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:07.705028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.759822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.799948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dbe03-258e-4b2a-bd7d-4dd21f5aa4d4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.821258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6c35-59bd-41de-95d7-2f7a8a83d757 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:07.847655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.848877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.849164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.849694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.856789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:07.857608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:07.857949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:07.858283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:07.859192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.860736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:07.881363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:07.882351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:52:07.883409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:07.884111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 316/653] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:07.887962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:07.905845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:07.952090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:07.953889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.004920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:08.019343 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f279-bfdb-4a9a-a535-bf200ee688af None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.066942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.068089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.068527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.068955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.074376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 338/654] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:52:08.074376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.087156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.089365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:08.113275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:08.114362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:08.115457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:08.115457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:08.115457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:08.115457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:08.117107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 317/655] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:08.118050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.199439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a99c96-84fe-481f-b5ff-533de590d138 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.201313 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:08.241174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9c4ab-aa71-4d73-bfb3-45e771cc40a4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.285094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.286152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.286604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.287014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.299436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.301197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:08.321047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:08.322150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:08.325509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:08.325509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:08.325509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:08.325509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:08.332781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 318/656] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:08.333966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.373720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.374503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.374843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.375230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.376205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:08.376538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.378081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.395958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 339/657] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:08.401549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.410561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:08.465696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc435ad-f78f-4f28-83ca-4c1c6e0968fc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.488631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:08.515395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881a5c-6ecc-4c42-957c-17a752d81490 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.515567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.516307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.516704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.517069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.517911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:08.518311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.519785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.536461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 319/658] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:08.537452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.558049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.559308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.559727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.560154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.561067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:08.561507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.563799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.584759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 340/659] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:08.584759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.659279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0920f-ba7b-4d72-8316-a1bd8d6e0a4d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.665981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:08.703127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fe23-286c-412a-b1bf-cbde60594a40 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.706746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.707566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.708010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.708420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.744105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.745575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.746221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.746651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.755972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.758197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.764860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:08.783678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:08.784746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:52:08.785690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:08.786948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 341/660] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:08.787954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.801980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.803891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.910246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5528-2e00-425a-9051-48e172c7693d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:08.934347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 320/661] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:52:08.935568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:08.948115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:08.961133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:08.962330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:08.962614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:08.962886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:08.972166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:08.973651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:08.996057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:08.997112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:08.998007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:09.001070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 342/662] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:09.003535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.029138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:09.066002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcac3eb-30be-4696-848e-794d4e9c72e3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.105513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.106370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.106738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.107097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.108033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:09.108674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.110211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.121196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ada3-3ef8-4002-b77f-460c9512ee68 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.129517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 321/663] 10.222.0.35 () {56 vars in 1139 bytes} [Thu May 19 11:52:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:09.130736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.157282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.158093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.158355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.158615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.170909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.172329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:09.191462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:09.192409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:09.193335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:09.193335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:09.193335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:09.193335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:09.197585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 343/664] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:09.198456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.239679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab54aca-b130-4399-8a7c-72a1ed060e01 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.241545 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:09.278221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.278902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.279148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.279415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.280195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:09.280503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.281988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.284885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:09.300165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 322/665] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:09.300165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.307861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d23d-2664-4efa-b8cb-55ff3b46e0dc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.341991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.342640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.342916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.343188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.406034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6375b-70b3-4cc1-8c53-fac7c7af790e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.418529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.419993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.446107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7004b-410e-409e-b574-20a6edbd6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.446941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7004b-410e-409e-b574-20a6edbd6c69 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.447219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7004b-410e-409e-b574-20a6edbd6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.447487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7004b-410e-409e-b574-20a6edbd6c69 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.448397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7004b-410e-409e-b574-20a6edbd6c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:09.449018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7004b-410e-409e-b574-20a6edbd6c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.450688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7004b-410e-409e-b574-20a6edbd6c69 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.461528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:09.465866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 323/666] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:09.467190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90e2b-3f72-47d1-a483-cd3920ea4e8e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.467475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90e2b-3f72-47d1-a483-cd3920ea4e8e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.467747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90e2b-3f72-47d1-a483-cd3920ea4e8e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.469166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 324/667] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:09.473715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90e2b-3f72-47d1-a483-cd3920ea4e8e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.531411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 344/668] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:52:09.532288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.538045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:09.587015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90e2b-3f72-47d1-a483-cd3920ea4e8e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.623371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2bea2-0a1a-4535-a61d-177dc7c2696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.624025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2bea2-0a1a-4535-a61d-177dc7c2696a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.624300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2bea2-0a1a-4535-a61d-177dc7c2696a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.624570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2bea2-0a1a-4535-a61d-177dc7c2696a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.625588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2bea2-0a1a-4535-a61d-177dc7c2696a None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=9f1470011d984f45be788072525f82cb) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:09.625894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2bea2-0a1a-4535-a61d-177dc7c2696a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.627321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2bea2-0a1a-4535-a61d-177dc7c2696a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.633274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 325/669] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/role_assignments?user.id=9f1470011d984f45be788072525f82cb&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:09.634448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2733-a92a-49a7-a74d-c35b0252cf82 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.634728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2733-a92a-49a7-a74d-c35b0252cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.634998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2733-a92a-49a7-a74d-c35b0252cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.657265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0430cf-112b-4f6f-87ac-d4f0c06f9381 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.662430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-499c2733-a92a-49a7-a74d-c35b0252cf82 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:09.663683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-499c2733-a92a-49a7-a74d-c35b0252cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:09.708338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.710019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.710525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.711035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.721909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.724418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.727741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:09.746943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:09.747891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:09.748827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:09.751396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 345/670] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:09.752460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.752981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 326/671] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:09.757361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c2733-a92a-49a7-a74d-c35b0252cf82 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.817924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:09.866827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250a17-d1c4-4e18-ae7b-53f74a88699e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.877345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c2733-a92a-49a7-a74d-c35b0252cf82 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:09.906574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.907369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.907642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.907907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.916786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f9f5-4d69-4d59-9a57-803dede194ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:09.917445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f9f5-4d69-4d59-9a57-803dede194ee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.917718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f9f5-4d69-4d59-9a57-803dede194ee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.917981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f9f5-4d69-4d59-9a57-803dede194ee None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.918768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012f9f5-4d69-4d59-9a57-803dede194ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:09.919070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012f9f5-4d69-4d59-9a57-803dede194ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.919164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:09.920496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012f9f5-4d69-4d59-9a57-803dede194ee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.920599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:09.937878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 327/672] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:09.937878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594c55b-f100-4ab3-b01a-c037f588da59 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:09.937878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594c55b-f100-4ab3-b01a-c037f588da59 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:09.937878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594c55b-f100-4ab3-b01a-c037f588da59 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:09.937878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 328/673] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:09.937878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594c55b-f100-4ab3-b01a-c037f588da59 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:09.943971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:09.944969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:09.947248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:09.947248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:09.947248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:09.947248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:09.947248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 346/674] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:09.947248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.005799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:10.053654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594c55b-f100-4ab3-b01a-c037f588da59 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.056605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132a2f-e7ea-4cd8-8949-1b45f34330a8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.064818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:10.090330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.090672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1e30d-a8b8-43ca-b5d1-7064493ffaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.091119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.091287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e30d-a8b8-43ca-b5d1-7064493ffaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.091382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.091560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e30d-a8b8-43ca-b5d1-7064493ffaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.091672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.091846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e30d-a8b8-43ca-b5d1-7064493ffaf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.092661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e30d-a8b8-43ca-b5d1-7064493ffaf1 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=8935a1ea9f94443f903d479401706473) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:10.092983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e30d-a8b8-43ca-b5d1-7064493ffaf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.094434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e30d-a8b8-43ca-b5d1-7064493ffaf1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.100580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 347/675] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/role_assignments?user.id=8935a1ea9f94443f903d479401706473&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:10.101832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc48708-4706-49cb-848c-d9487572a735 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.102094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc48708-4706-49cb-848c-d9487572a735 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.102362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc48708-4706-49cb-848c-d9487572a735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.113604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:10.121891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:10.122966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:10.123806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 329/676] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:10.124487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.128747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4dc48708-4706-49cb-848c-d9487572a735 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:10.130271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4dc48708-4706-49cb-848c-d9487572a735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:10.217031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 348/677] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:10.218354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc48708-4706-49cb-848c-d9487572a735 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.238851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5823-cac0-4a17-ad36-bea808b39eee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.276184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.277300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.277827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.278311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.279248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:10.279765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.281431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.286416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:10.297166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 330/678] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:10.298356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.330895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:10.359157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc48708-4706-49cb-848c-d9487572a735 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.401031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.401731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.402015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.402292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.403055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:10.403359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.404823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.414056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 349/679] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:10.414902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.427909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07f8e1-fa12-4f43-8659-8526c7a4d721 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.479643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.481496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.481975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.482686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.506796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:10.517195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:10.518118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:10.518953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:10.522136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 331/680] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:10.523059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.538122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cc71b-ccb4-48bf-a5f4-9086fe612b10 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.546644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:10.576261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.577272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.578018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.578018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.585666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.587193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:10.601228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:10.602236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:10.603115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:10.607276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 350/681] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:10.608180 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.650360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:10.664125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f32e0-55e5-44d3-b8a6-5fba5a6bd9d5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.714638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.716094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.716931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.717663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.719308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278c29a-5247-4443-a5f5-d1368b8559fe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.732517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.735036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.755134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.755904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.756295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.756655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.757608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:10.758003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:10.759148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:10.760004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:10.760931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:10.760931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:10.760931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:10.760931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:10.761166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.762359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 332/682] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:10.763338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.771277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 351/683] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:10.772380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.809645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:10.883149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d115274-e775-4b69-8efa-ceaf9f3e1eff None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.896605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0106cd3-48c7-433c-bc8f-3fceede9608c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:10.930815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.931973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.932400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.932923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.933366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:10.934028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:10.934241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:10.934629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:10.934755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.935071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:10.935899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:10.936302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:10.936809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.937970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:10.951809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 352/684] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:10.952904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 333/685] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:10.960804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.960953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:10.963678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:11.061951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:11.075785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9803-b7df-4487-bd10-2a20b1565432 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.078117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56b9d3-cae2-4605-93b0-d51f21acf6c9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.112864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.113659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.114251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.114450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.114731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.115000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.115330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.115790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.122418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.123953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.127450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.129168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:11.138941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:11.139890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:11.141241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:11.144744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 334/686] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:11.145575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:11.152034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:11.153138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:11.154085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:11.154085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:11.154085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:11.154085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:11.156311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 353/687] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:11.157692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:11.210198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:11.251397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70386f2-23c0-4a05-b51c-71486276b392 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.270102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76a1e-7386-49b1-bb4b-791dbf94a1f1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.289771 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.290752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.291030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.291302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.292140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=9bb4c7ed74924ac4ad8f759437891569) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:11.292448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.293904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.300739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 335/688] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/role_assignments?user.id=9bb4c7ed74924ac4ad8f759437891569&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:11.301638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:11.310271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.311619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.312189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.312715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.313955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:11.314507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.316515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.329007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:11.339743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 354/689] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:11.349921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:11.425680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de00ef-aae0-4564-b251-abaf8bfcf8e1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.461167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:11.465719 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.466611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.467034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.467471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.468379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:11.468852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.470948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.484624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 336/690] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:11.502254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:11.580979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe508d7-2d6c-4fb4-85f3-8ecee2f2bb17 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.627328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe09083-5f3b-4d27-8a35-f3cf584512b0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.631897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.632877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.633307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.633726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.672222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.673669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.674044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.674440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.685498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.688450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:11.705601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:11.706823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:11.707858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:11.708746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 337/691] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:11.714224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:11.723450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:11.728945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.731695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.778023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:11.871633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525d01f-2975-4e30-b844-db16cd549360 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:11.889774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 355/692] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:52:11.895247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:11.936864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:11.938045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:11.938545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:11.939024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:11.940137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:11.940725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:11.942444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:11.978367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 338/693] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:11.990924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.007335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.011950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ab952-c096-46e7-84ee-e9557136af4f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.048326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.049328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.049677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.050018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.060819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.062595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:12.108676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:12.109636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:12.110526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:12.110526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:12.110526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:12.110526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:12.110526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 356/694] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:12.115536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.126889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7044241-05dd-434d-a316-d1e9220a8cc3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.130229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.173781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7faa2-da0c-48f9-a926-5b2ca879172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.174936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7faa2-da0c-48f9-a926-5b2ca879172a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.175842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7faa2-da0c-48f9-a926-5b2ca879172a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.176287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7faa2-da0c-48f9-a926-5b2ca879172a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.233282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86d934-603e-429a-bc84-2acae1ec0a71 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.269312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7faa2-da0c-48f9-a926-5b2ca879172a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.271045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7faa2-da0c-48f9-a926-5b2ca879172a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.271726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5426c6-6d92-4143-b1e9-232ebe2d574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.272412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5426c6-6d92-4143-b1e9-232ebe2d574b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.272759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5426c6-6d92-4143-b1e9-232ebe2d574b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.273037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5426c6-6d92-4143-b1e9-232ebe2d574b None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.273858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5426c6-6d92-4143-b1e9-232ebe2d574b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:12.274523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5426c6-6d92-4143-b1e9-232ebe2d574b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.277078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5426c6-6d92-4143-b1e9-232ebe2d574b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.294102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 357/695] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:12.295906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273adc-c79a-42b0-bfff-5764e71a8703 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.296192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273adc-c79a-42b0-bfff-5764e71a8703 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.296467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273adc-c79a-42b0-bfff-5764e71a8703 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.298860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 358/696] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:12.299591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273adc-c79a-42b0-bfff-5764e71a8703 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.317069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.395999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 339/697] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:52:12.395999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023cd89-23c8-4005-88f2-0265000bdc3b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.395999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023cd89-23c8-4005-88f2-0265000bdc3b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.395999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023cd89-23c8-4005-88f2-0265000bdc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.406686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.422485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e023cd89-23c8-4005-88f2-0265000bdc3b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:12.424700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e023cd89-23c8-4005-88f2-0265000bdc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:12.441653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273adc-c79a-42b0-bfff-5764e71a8703 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.477296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.478093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.478374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.478646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.485801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.487267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:12.507140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:12.508077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:12.508996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 359/698] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:12.509512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.515792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 340/699] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:12.517432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b27-0ae1-4c0d-9bcb-3c4457d953c9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.517922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b27-0ae1-4c0d-9bcb-3c4457d953c9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.518390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b27-0ae1-4c0d-9bcb-3c4457d953c9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.524482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 341/700] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:12.525500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4b27-0ae1-4c0d-9bcb-3c4457d953c9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.583765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.618614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb9b3-11d1-42b3-aea5-31a9c65a3f32 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.630199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4b27-0ae1-4c0d-9bcb-3c4457d953c9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.652916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3b324-383e-4450-809f-5edb27a52e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.653623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b324-383e-4450-809f-5edb27a52e62 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.653901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b324-383e-4450-809f-5edb27a52e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.654175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b324-383e-4450-809f-5edb27a52e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.664473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3b324-383e-4450-809f-5edb27a52e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.666315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3b324-383e-4450-809f-5edb27a52e62 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.669496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.670333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.670606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.670920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.671712 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:12.672072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.673832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.675781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-66d3b324-383e-4450-809f-5edb27a52e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:12.684530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:12.685451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:12.686345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:12.686345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:12.686345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:12.686345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:12.686345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 360/701] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:12.687177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434cbc-3cd4-409a-b145-6b2104c9f1e4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.687275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434cbc-3cd4-409a-b145-6b2104c9f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.687540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434cbc-3cd4-409a-b145-6b2104c9f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.697350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 342/702] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:12.698025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.705305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-29434cbc-3cd4-409a-b145-6b2104c9f1e4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:12.706490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-29434cbc-3cd4-409a-b145-6b2104c9f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:12.775264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 361/703] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:12.776979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29434cbc-3cd4-409a-b145-6b2104c9f1e4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.813991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880cb39-7d1b-450f-8594-ac876f07e6fd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.839561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.849605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.850403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.850682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.850954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.862562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.864046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:12.882608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:12.883573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:12.884481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:12.884481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:12.884481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:12.884481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:12.884481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 343/704] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:12.884812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.894262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29434cbc-3cd4-409a-b145-6b2104c9f1e4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:12.933435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:12.942237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:12.942908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:12.943189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:12.943564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:12.944912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:12.945441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:12.946844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:12.963173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 362/705] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:12.963173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:12.998703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fe6d-7059-496a-8508-f466ad570f67 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.035551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.036202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.036481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.036775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.037743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=7d4f967c85db412aacf6c8b441dbdeb1) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:13.038049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.040947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.052786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 344/706] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/role_assignments?user.id=7d4f967c85db412aacf6c8b441dbdeb1&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:13.052786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:13.093855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c1d39-3aca-487c-a07a-2f40d812082e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.112091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:13.145875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.146746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.147055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.147340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.148372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.150563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:13.172973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:13.174022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:13.174872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:13.177934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 363/707] 10.222.0.35 () {56 vars in 1129 bytes} [Thu May 19 11:52:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:13.177934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:13.198693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe974-e7a2-4666-97f9-c9f8780ac84c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.214584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:13.245903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.246577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.246858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.247139 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.247917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:13.248224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.249919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.268245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 345/708] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:13.273555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:13.313481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54823004-10f8-4b75-ba6b-8c8938f06b5b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.355143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.357031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.357031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.357031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.364396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.365908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:13.381384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:13.382335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:13.383325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:13.387381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 364/709] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:13.388918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:13.394240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b06273-8da5-4a9a-8d51-d78e22839196 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.427018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:13.435722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.436077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.436349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.440672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.440672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:13.440672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.440672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.451391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 346/710] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 11:52:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:13.452245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:13.492340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:13.503153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358a3b-8927-4ea8-9e0a-bc4dfdc86ee0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.542408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.543092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.543373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.543647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.544428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.546037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.569464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 365/711] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:52:13 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:13.570435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:13.588820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f665-f90c-4a94-82cb-ec9b7cc4b9ff None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.666652 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.667332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.667610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.667878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.668689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:13.669000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.670434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.681620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:13.688052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a946f2-eae3-424f-b871-d7a31a91eb6e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.698812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 347/712] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:13.718601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:13.737602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd44605-04ad-45c2-8a24-80f1e4f777c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.738386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd44605-04ad-45c2-8a24-80f1e4f777c3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.738674 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd44605-04ad-45c2-8a24-80f1e4f777c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.738950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd44605-04ad-45c2-8a24-80f1e4f777c3 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.739682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd44605-04ad-45c2-8a24-80f1e4f777c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:13.739991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd44605-04ad-45c2-8a24-80f1e4f777c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.741561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd44605-04ad-45c2-8a24-80f1e4f777c3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.748624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 366/713] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 11:52:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:13.852740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:13.864873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c7370-ce89-4fef-b214-bd4b7c63e2e5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:13.910436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c3d8f-1ad0-42db-abf9-25528d37bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:13.911104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c3d8f-1ad0-42db-abf9-25528d37bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:13.911379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c3d8f-1ad0-42db-abf9-25528d37bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:13.911645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c3d8f-1ad0-42db-abf9-25528d37bfc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:13.912484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c3d8f-1ad0-42db-abf9-25528d37bfc8 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=aa37bb31a4fa42d5937b70c993a994fe) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:13.912822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c3d8f-1ad0-42db-abf9-25528d37bfc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:13.914341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c3d8f-1ad0-42db-abf9-25528d37bfc8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:13.921843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 348/714] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:13 2022] GET /identity/v3/role_assignments?user.id=aa37bb31a4fa42d5937b70c993a994fe&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:14.059897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fabd-5157-4dd7-b823-fc0f41a9f54b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:14.060433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fabd-5157-4dd7-b823-fc0f41a9f54b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:14.060433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58fabd-5157-4dd7-b823-fc0f41a9f54b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:14.062266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 367/715] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:14.067493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697cb41-bb5c-4a41-878c-36e80b809f55 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:14.067787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697cb41-bb5c-4a41-878c-36e80b809f55 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:14.068044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697cb41-bb5c-4a41-878c-36e80b809f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:14.089746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2697cb41-bb5c-4a41-878c-36e80b809f55 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:14.090971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2697cb41-bb5c-4a41-878c-36e80b809f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:14.174314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 349/716] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:14.196189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fabd-5157-4dd7-b823-fc0f41a9f54b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:14.322416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58fabd-5157-4dd7-b823-fc0f41a9f54b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:14.362199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:14.363005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:14.363283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:14.363551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] PATH_INFO: `/v3/services/network` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:14.364210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:14.365621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:14.380498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:14.381625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:14.382529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 368/717] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:14 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:14.387859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697cb41-bb5c-4a41-878c-36e80b809f55 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:14.544617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:14.563801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697cb41-bb5c-4a41-878c-36e80b809f55 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:14.600466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c1a63-293a-440e-b657-13905317a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:14.601072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c1a63-293a-440e-b657-13905317a1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:14.601382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c1a63-293a-440e-b657-13905317a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:14.601654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c1a63-293a-440e-b657-13905317a1f2 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:14.602367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c1a63-293a-440e-b657-13905317a1f2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:14.602736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c1a63-293a-440e-b657-13905317a1f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:14.604167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c1a63-293a-440e-b657-13905317a1f2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:14.609084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 350/718] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:14.614160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:14.652000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:14.739274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adf2a-3d35-4950-a560-6781841fd877 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:14.775882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9aa8e-e283-437e-b491-895a37aa4394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:14.776548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9aa8e-e283-437e-b491-895a37aa4394 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:14.776859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9aa8e-e283-437e-b491-895a37aa4394 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:14.777135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9aa8e-e283-437e-b491-895a37aa4394 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:14.777847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9aa8e-e283-437e-b491-895a37aa4394 None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:14.778151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9aa8e-e283-437e-b491-895a37aa4394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:14.779649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9aa8e-e283-437e-b491-895a37aa4394 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:14.784595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 369/719] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:15.794066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a010-5371-4ca8-9f24-7fd3348b7ffe None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:15.794565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a010-5371-4ca8-9f24-7fd3348b7ffe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:15.794565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a010-5371-4ca8-9f24-7fd3348b7ffe None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:15.796147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 351/720] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:15.801530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41be9-fbf6-4cdc-a509-cf2793b39f3a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:15.802003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41be9-fbf6-4cdc-a509-cf2793b39f3a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:15.802080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41be9-fbf6-4cdc-a509-cf2793b39f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:15.825919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-87f41be9-fbf6-4cdc-a509-cf2793b39f3a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:15.827384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-87f41be9-fbf6-4cdc-a509-cf2793b39f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:15.926917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 370/721] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:52:15.965638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a010-5371-4ca8-9f24-7fd3348b7ffe None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:16.108821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a010-5371-4ca8-9f24-7fd3348b7ffe None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:16.154620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1100642-2482-4be3-89f3-d161d616159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:16.155457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1100642-2482-4be3-89f3-d161d616159b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.155736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1100642-2482-4be3-89f3-d161d616159b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.156008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1100642-2482-4be3-89f3-d161d616159b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.175766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1100642-2482-4be3-89f3-d161d616159b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e1100642-2482-4be3-89f3-d161d616159b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:16.183609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:16.184528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:16.185401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:16.186055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 352/722] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:16.190820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41be9-fbf6-4cdc-a509-cf2793b39f3a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:16.225803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:16.292001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acf8f-ed67-44fe-b365-8b87e3cece2d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.292306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acf8f-ed67-44fe-b365-8b87e3cece2d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.292750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acf8f-ed67-44fe-b365-8b87e3cece2d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.294483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 353/723] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:16.300029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9fe6-9d6b-4c62-b7c5-992f02eb99d0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.300309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9fe6-9d6b-4c62-b7c5-992f02eb99d0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.300577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9fe6-9d6b-4c62-b7c5-992f02eb99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.363919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41be9-fbf6-4cdc-a509-cf2793b39f3a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:16.460801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2dff9fe6-9d6b-4c62-b7c5-992f02eb99d0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:16.462045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2dff9fe6-9d6b-4c62-b7c5-992f02eb99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:16.462510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:16.463579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.464055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.464526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.465520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:16.465836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:16.467232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:16.475084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:16.488389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 371/724] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:16.494573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:16.574873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 354/725] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:16.584823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:16.608784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82bf26-bdab-4cd9-8580-b4f66505c8f5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:16.611233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9fe6-9d6b-4c62-b7c5-992f02eb99d0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:16.661771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23fba-bb8f-4524-a806-3fbc148edc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:16.662501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23fba-bb8f-4524-a806-3fbc148edc11 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.662771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23fba-bb8f-4524-a806-3fbc148edc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.663038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23fba-bb8f-4524-a806-3fbc148edc11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.679938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d23fba-bb8f-4524-a806-3fbc148edc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:16.681428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d23fba-bb8f-4524-a806-3fbc148edc11 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b5d23fba-bb8f-4524-a806-3fbc148edc11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:16.711540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:16.712493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:16.713456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:16.713456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:16.713456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:16.713456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:16.717280 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 372/726] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:16.718671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d07030-7134-446b-9214-a827a04a01e8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.718960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d07030-7134-446b-9214-a827a04a01e8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.719234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d07030-7134-446b-9214-a827a04a01e8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.721121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 373/727] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:16.721939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d07030-7134-446b-9214-a827a04a01e8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:16.771767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9fe6-9d6b-4c62-b7c5-992f02eb99d0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:16.805945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a66fb-d228-42d6-a816-7e540728fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:16.806581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a66fb-d228-42d6-a816-7e540728fe27 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.806861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a66fb-d228-42d6-a816-7e540728fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.807124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a66fb-d228-42d6-a816-7e540728fe27 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.807845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a66fb-d228-42d6-a816-7e540728fe27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:16.809236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a66fb-d228-42d6-a816-7e540728fe27 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:16.828682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 355/728] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:16 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:16.830116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc4db-8907-4938-be84-e701eda2b25a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.830400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc4db-8907-4938-be84-e701eda2b25a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.830674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc4db-8907-4938-be84-e701eda2b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.835593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:16.849161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-813cc4db-8907-4938-be84-e701eda2b25a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:16.850382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-813cc4db-8907-4938-be84-e701eda2b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:16.851911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d07030-7134-446b-9214-a827a04a01e8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:16.885679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:16.901359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2d29c-279f-4fb5-80e2-ed5f9ae8d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:16.903077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2d29c-279f-4fb5-80e2-ed5f9ae8d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.903619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2d29c-279f-4fb5-80e2-ed5f9ae8d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.904584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2d29c-279f-4fb5-80e2-ed5f9ae8d1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.905988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2d29c-279f-4fb5-80e2-ed5f9ae8d1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:16.906594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2d29c-279f-4fb5-80e2-ed5f9ae8d1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:16.909414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2d29c-279f-4fb5-80e2-ed5f9ae8d1e5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:16.928756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 374/729] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:16.930579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8bf53-d14b-497b-a733-30f99facb820 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.931081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8bf53-d14b-497b-a733-30f99facb820 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.931625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8bf53-d14b-497b-a733-30f99facb820 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.933631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 375/730] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:16.934783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8bf53-d14b-497b-a733-30f99facb820 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:16.936107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 356/731] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:16.942159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ee692-d0a9-44d7-9033-cd04c6888911 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:16.942450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ee692-d0a9-44d7-9033-cd04c6888911 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:16.942727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ee692-d0a9-44d7-9033-cd04c6888911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:16.975411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b32ee692-d0a9-44d7-9033-cd04c6888911 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:16.976708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b32ee692-d0a9-44d7-9033-cd04c6888911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:17.059994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 357/732] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:17.061427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ee692-d0a9-44d7-9033-cd04c6888911 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.084093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8bf53-d14b-497b-a733-30f99facb820 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.129537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.130144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.130777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.131075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.131350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.139888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.142684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:17.158306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:17.159332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 376/733] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:52:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:17.161121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.187692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ee692-d0a9-44d7-9033-cd04c6888911 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.210087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.233912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.235494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.236191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.236661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.249841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:17.260066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:17.261072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:17.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:17.264747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 358/734] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:17.265764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.273919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89f97-f1e1-4aa4-a223-fa1c74692c5f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.318008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.319040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.319412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.319833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.333460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:17.343251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:17.344361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:17.345247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:17.348715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 377/735] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:17.349697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.378955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78967d-9842-4e5d-8f1e-9ce5ad420ec6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.405002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.418885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.419958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.420415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.420963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.421976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:17.422457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.424168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.444262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 359/736] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:17.445527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26c709-90c1-4f95-9e08-13630570c7d3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.462595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.497831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.498652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.498984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.499356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.500223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:17.500573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.502098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.511865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 378/737] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:17.512875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.562188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e08d-9262-4b05-b127-06a1ee76cac6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.597902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.598876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.599361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.599822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.600787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:17.601350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.602932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.616157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c9459-5074-4fee-9da8-c980d1fd3ce7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.616504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 360/738] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:17.617643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.648909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.649697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.650188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.650297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.661371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.662807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.663764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:17.683353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:17.684334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:17.686083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:17.686083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:17.686083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:17.686083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:17.686083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 379/739] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:17.686083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.705019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.732006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48786d04-cab3-4c60-a244-c0294cd03244 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.767921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cfc74-61ba-477f-9552-3b34e7244095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.768849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cfc74-61ba-477f-9552-3b34e7244095 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.769158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cfc74-61ba-477f-9552-3b34e7244095 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.769434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cfc74-61ba-477f-9552-3b34e7244095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.781372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cfc74-61ba-477f-9552-3b34e7244095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.783643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cfc74-61ba-477f-9552-3b34e7244095 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.790362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabf83-457c-44bd-881b-0caaa83274b6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c02cfc74-61ba-477f-9552-3b34e7244095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:17.802008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:17.802905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:17.803796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:17.803796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:17.803796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:17.803796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:17.803796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 361/740] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:17.804925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e9304-da13-43a6-b72e-9ddba605a5d1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.805186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e9304-da13-43a6-b72e-9ddba605a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.805475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e9304-da13-43a6-b72e-9ddba605a5d1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.808900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 362/741] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:17.809601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e9304-da13-43a6-b72e-9ddba605a5d1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.831427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.832206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.832479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.832782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.843405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.844876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:17.862713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:17.864038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:17.864966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:17.864966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:17.864966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:17.864966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:17.864966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 380/742] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:17.864966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:17.913169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.922377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e9304-da13-43a6-b72e-9ddba605a5d1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.940760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:17.958293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e84bef-a63f-4540-ba9a-631f108d14a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:17.958881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e84bef-a63f-4540-ba9a-631f108d14a7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.959160 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e84bef-a63f-4540-ba9a-631f108d14a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.959429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e84bef-a63f-4540-ba9a-631f108d14a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.960266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e84bef-a63f-4540-ba9a-631f108d14a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:17.960592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e84bef-a63f-4540-ba9a-631f108d14a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:17.961994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e84bef-a63f-4540-ba9a-631f108d14a7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:17.971009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384d1d-d811-47b8-bf87-4d32dd66175e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:17.974582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 363/743] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:17.975605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa56df9-4923-4f59-bcad-6c6d593fb5fb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:17.975888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa56df9-4923-4f59-bcad-6c6d593fb5fb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:17.976223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa56df9-4923-4f59-bcad-6c6d593fb5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:17.992460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-faa56df9-4923-4f59-bcad-6c6d593fb5fb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:17.993694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-faa56df9-4923-4f59-bcad-6c6d593fb5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:18.010961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.011618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.011893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.012157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.012904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:18.013206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.014577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.026731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 381/744] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:18.027522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.069898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 364/745] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:52:18.071063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa56df9-4923-4f59-bcad-6c6d593fb5fb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.149233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b324-4cde-43e7-8532-f3179fba3b91 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.163227 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:18.180407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:18.186132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa56df9-4923-4f59-bcad-6c6d593fb5fb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.187258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.187921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.188196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.188468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.189231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:18.189522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.190907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.206862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 382/746] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:18.206862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.231282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721a87-9325-403a-b820-df439dde7662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.232087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721a87-9325-403a-b820-df439dde7662 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.232500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721a87-9325-403a-b820-df439dde7662 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.232797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721a87-9325-403a-b820-df439dde7662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.240609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721a87-9325-403a-b820-df439dde7662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.242126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721a87-9325-403a-b820-df439dde7662 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-32721a87-9325-403a-b820-df439dde7662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:18.256874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:18.257908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 365/747] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:18.258804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721a87-9325-403a-b820-df439dde7662 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.309737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dac65-1868-4918-be4f-00e12b1bf69c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.350938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.352166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.352686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.353651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.364651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.365165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721a87-9325-403a-b820-df439dde7662 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.366183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:18.381113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:18.382034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:18.382990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:18.386936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 383/748] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:18.387719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.402028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.402820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.403024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.403294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.404279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.405402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.420072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 366/749] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:18 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:18.421055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.430532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:18.462103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:18.529147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c250e3-5312-4198-99d6-dad4a6087401 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.582321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.583531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.584003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.584442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.593107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5aa7d-807d-4748-9cde-c726e73a4011 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.594547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.596208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:18.612339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:18.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:18.614310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:18.617204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 384/750] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:18.618054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.651975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.653353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.653532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.653775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.654755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:18.655066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.658114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.672313 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 367/751] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:18.673494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.746981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b876c-01df-46cb-89d1-311f268e2669 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.754575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:18.760631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:18.785372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.786049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.786323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.786588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.787430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:18.787707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c50e-d463-4dde-b0c5-fb4a697cc17b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.787825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.789950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.816513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 385/752] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:18.817520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.829305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.829972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.830350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.830629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.831473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:18.831775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.833331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.856633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 368/753] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:18.857599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.922220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cba87-faec-490d-9499-3388a9a9c455 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.958089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:18.959082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:18.959359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:18.959725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/7d4f967c85db412aacf6c8b441dbdeb1/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:18.961808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=7d4f967c85db412aacf6c8b441dbdeb1, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:18.962445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc0e5c-ad36-4b0a-8c4d-b6bd82efa4e9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:18.963299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:18.978464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 386/754] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:18 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/7d4f967c85db412aacf6c8b441dbdeb1/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:52:18.979335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:18.988479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.011036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.033551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2ea42-e632-48c6-9ced-d62ee31087c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:19.034364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ea42-e632-48c6-9ced-d62ee31087c6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.034928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ea42-e632-48c6-9ced-d62ee31087c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.034928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ea42-e632-48c6-9ced-d62ee31087c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.103159 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e74f-1240-41fe-b68b-69553f09b676 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:19.151177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d18ebf-8730-45f5-9c74-b6545f2ccd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:19.151846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d18ebf-8730-45f5-9c74-b6545f2ccd44 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.152119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d18ebf-8730-45f5-9c74-b6545f2ccd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.152385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d18ebf-8730-45f5-9c74-b6545f2ccd44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.197408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2ea42-e632-48c6-9ced-d62ee31087c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:19.198196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2ea42-e632-48c6-9ced-d62ee31087c6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:19.264214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d18ebf-8730-45f5-9c74-b6545f2ccd44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:19.265969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d18ebf-8730-45f5-9c74-b6545f2ccd44 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:19.297739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.334546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 369/755] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:19.336366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56875-462f-4770-aecf-d8a916c61079 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.336877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56875-462f-4770-aecf-d8a916c61079 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.337472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56875-462f-4770-aecf-d8a916c61079 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.339509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 370/756] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:19.340432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56875-462f-4770-aecf-d8a916c61079 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:19.366264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.406410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 387/757] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:19.408148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f566-2d3e-433b-937f-87278afb9146 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.408917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f566-2d3e-433b-937f-87278afb9146 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.409397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f566-2d3e-433b-937f-87278afb9146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.426938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4f00f566-2d3e-433b-937f-87278afb9146 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:19.428508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4f00f566-2d3e-433b-937f-87278afb9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:19.476854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56875-462f-4770-aecf-d8a916c61079 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:19.515566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 388/758] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:19.516973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f566-2d3e-433b-937f-87278afb9146 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:19.538708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:19.541089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.541368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.541637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.552202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:19.553755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:19.571735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:19.572738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:19.573632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:19.573632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:19.573632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:19.573632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:19.577592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 371/759] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:19.578266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:19.610449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.658551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.666450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f566-2d3e-433b-937f-87278afb9146 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:19.701975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:19.702768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.703046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.703313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.704005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818b49-8a1f-4101-872f-ef2a8e3eb04f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:19.714399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:19.716048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:19.736259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:19.737283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:19.738234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:19.738234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:19.738234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:19.738234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:19.742178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 389/760] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:19.743230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:19.750649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:19.751793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.752808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.753290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.754582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:19.756583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:19.777088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:19.778053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:19.778979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:19.783725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 372/761] 10.222.0.35 () {56 vars in 1129 bytes} [Thu May 19 11:52:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:19.783725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:19.855146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdc8c-6cf7-49b9-a4bf-971b3ef149d9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:19.863697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.892356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:19.893452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.893924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.894417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.895334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:19.895826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:19.897457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:19.909864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 390/762] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:19.911049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:19.919129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32367118-d694-42e1-87be-b05a0fc13f63 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:19.955669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:19.956874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:19.958078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:19.958584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:19.959502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:19.960016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:19.961984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:19.964164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:19.978497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 373/763] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:19.980002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.044805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd803b5e-795a-421f-a0cd-1527b13c4fbb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.079545 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.080524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.081035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.081541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.082434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:20.082941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.084499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.089548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 391/764] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 11:52:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.090538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.104244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48d024-86fb-41d2-a8d6-e6ff2b7046cc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.133003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:20.145516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.146537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.146671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.146832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.153848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.155494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:20.169609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:20.170555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:20.171432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 374/765] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:20.172384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.213307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb99673-8c63-4884-94e1-a387568ccc01 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.231581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:20.263010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b14463-0719-4f7e-839d-9331008307df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.264199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b14463-0719-4f7e-839d-9331008307df None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.264736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b14463-0719-4f7e-839d-9331008307df None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.265214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b14463-0719-4f7e-839d-9331008307df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.273132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b14463-0719-4f7e-839d-9331008307df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.274974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b14463-0719-4f7e-839d-9331008307df None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.278147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0e3c-4716-4eb1-97f7-e9852a7758fa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-82b14463-0719-4f7e-839d-9331008307df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:20.290682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:20.291686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:20.292560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:20.295243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 392/766] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:20.296420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b14463-0719-4f7e-839d-9331008307df None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.313672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.314150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.314431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.314707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.315501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:20.315715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.317140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.328334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 375/767] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.329383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.397039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:20.405270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b14463-0719-4f7e-839d-9331008307df None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.437164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c14bd-6f0e-4e9c-a544-36ebd15c8a8f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.443573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.444620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.445150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.445613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.446675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:20.447172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.449011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.454958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:20.465894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 393/768] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.467468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.476194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.476883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.477164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.477437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.478231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:20.478542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.480092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.494009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 376/769] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.494908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.579539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be3287-2730-4a01-a1db-31350c46cb0b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.610134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37460c-1745-43b6-8be6-79ccbdfda060 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.616136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.617189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.617664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.618128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.619203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] RBAC: Adding query filter params (interface=public, service_id=e9461b0431414ee0bad546a0751718fe, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:20.619753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.621517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.630256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 394/770] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/endpoints?service_id=e9461b0431414ee0bad546a0751718fe&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.631368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.652334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.653672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.654158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.654651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.655865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=b0ad031f63ba4d449df8f1f78116a890) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:20.656200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:20.657019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.658980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.666723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 377/771] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/role_assignments?user.id=b0ad031f63ba4d449df8f1f78116a890&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.668377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:20.753298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:20.830383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76194a7-ac83-434d-91c6-4d154a9b8b3c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.858379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514118-2f60-4dc3-8f30-ffbcceb502c5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:20.872475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06718d5-45c3-4a97-8b3d-940f61c21883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.873173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06718d5-45c3-4a97-8b3d-940f61c21883 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.873446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06718d5-45c3-4a97-8b3d-940f61c21883 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.873711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06718d5-45c3-4a97-8b3d-940f61c21883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.874543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06718d5-45c3-4a97-8b3d-940f61c21883 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=aa37bb31a4fa42d5937b70c993a994fe) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:20.874847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06718d5-45c3-4a97-8b3d-940f61c21883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.876294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06718d5-45c3-4a97-8b3d-940f61c21883 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.883260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 395/772] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/role_assignments?user.id=aa37bb31a4fa42d5937b70c993a994fe&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.884725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a217e3-a84a-436e-ac9b-c502ff870791 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.885009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a217e3-a84a-436e-ac9b-c502ff870791 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.885279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a217e3-a84a-436e-ac9b-c502ff870791 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.886955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 396/773] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:20.902650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6d94-6bd4-4790-be72-5a4abb5941a8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.902988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6d94-6bd4-4790-be72-5a4abb5941a8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.903216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6d94-6bd4-4790-be72-5a4abb5941a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.905083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:20.906092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:20.906582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:20.907078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:20.908022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:20.909936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:20.918067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 378/774] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:20 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:20.935803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-667c6d94-6bd4-4790-be72-5a4abb5941a8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:20.937496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-667c6d94-6bd4-4790-be72-5a4abb5941a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:21.017978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 397/775] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:21.057511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:21.176217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c050a29-ec30-4b67-b95f-9da4f8362bf3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:21.183376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:21.213794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6e46-e36b-4d63-82e9-e8a5fc3fee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:21.214602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6e46-e36b-4d63-82e9-e8a5fc3fee96 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:21.214882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6e46-e36b-4d63-82e9-e8a5fc3fee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:21.215154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6e46-e36b-4d63-82e9-e8a5fc3fee96 None admin] PATH_INFO: `/v3/services/network` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:21.215809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6e46-e36b-4d63-82e9-e8a5fc3fee96 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:21.217220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6e46-e36b-4d63-82e9-e8a5fc3fee96 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-fd5a6e46-e36b-4d63-82e9-e8a5fc3fee96 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:21.230242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:21.231297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:21.232123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 379/776] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:21 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:21.237704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6d94-6bd4-4790-be72-5a4abb5941a8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:21.249080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:21.391295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6d94-6bd4-4790-be72-5a4abb5941a8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:21.438477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:21.439058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:21.439341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:21.439615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:21.440333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] RBAC: Adding query filter params (name=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:21.440654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:21.442045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:21.453031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 398/777] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:21.454900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601a007-544f-4a66-b98e-9a0fee4f2ec9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:21.455329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601a007-544f-4a66-b98e-9a0fee4f2ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:21.455856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601a007-544f-4a66-b98e-9a0fee4f2ec9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:21.457834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 380/778] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:21.459679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:21.463950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5646d-c1bd-407c-9c67-22c57be4154c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:21.464235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5646d-c1bd-407c-9c67-22c57be4154c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:21.464511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5646d-c1bd-407c-9c67-22c57be4154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:21.505694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8fe5646d-c1bd-407c-9c67-22c57be4154c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:21.512661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8fe5646d-c1bd-407c-9c67-22c57be4154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:21.534884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:21.567309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93d033-1501-4caf-a991-d5ef0754c802 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:21.610132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:21.610803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:21.611078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:21.611351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:21.612065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:21.612374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:21.618604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:21.629312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 399/779] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:21.633071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:21.706403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 381/780] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:21.737702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782775c-ff7e-4ccc-9d42-d2f597ad62de None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:21.745694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5646d-c1bd-407c-9c67-22c57be4154c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:21.774550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:21.775237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:21.775522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:21.775800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:21.776612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] RBAC: Adding query filter params (interface=public, service_id=92e76e6af97b41c0b3bb171d68d22eae, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:21.776961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:21.778712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:21.784768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 400/781] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:52:21 2022] GET /identity/v3/endpoints?service_id=92e76e6af97b41c0b3bb171d68d22eae&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:21.785142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:21.793670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:21.939219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:21.942953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5646d-c1bd-407c-9c67-22c57be4154c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:21.986523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713fe0-fb64-4198-b1a4-cbcf07f1cf36 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:22.010770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:22.011630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:22.011957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:22.012228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:22.024473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:22.025414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:22.025910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:22.026376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:22.027257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:22.029010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:22.035404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 401/782] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:21 2022] GET /identity/v3/services => generated 772 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:22.040056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:22.048342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:22.049435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:22.050265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:22.053157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 382/783] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:22.063200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:22.145582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:22.189705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb84c4-d592-4c60-80e1-884592ea9677 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:22.239286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:22.239917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:22.240150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:22.240423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:22.241213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:22.241562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:22.242964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:22.257729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 402/784] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:22.263018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:22.384177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a42c7-ff50-416f-9c5d-ac7eee375fbe None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:22.424615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:22.425815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:22.426293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:22.426764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:22.438107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:22.439798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:22.457230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:22.458131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:22.459034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:22.459034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:22.459034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:22.459034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:22.461355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 383/785] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:22.466635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:22.603426 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d199-b644-49d2-9d41-e7a15178baed None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:22.638360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:22.648554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:22.649251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:22.649531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:22.649803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:22.650533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:22.650837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:22.652335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:22.669826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 403/786] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:22.675246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:22.702995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:22.810259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907e9ae-3c70-4f2f-9503-95736ce314a0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:22.858450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:22.859264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:22.859544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:22.859815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:22.869229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:22.870795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:22.886259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:22.887263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:22.888775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 384/787] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:52:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:22.893023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:23.020570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcdd4d-1b9c-4416-9329-3d53040fcb44 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:23.068160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ab8f-a1c5-49ae-be1a-1b912d122850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:23.068777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ab8f-a1c5-49ae-be1a-1b912d122850 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.069057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ab8f-a1c5-49ae-be1a-1b912d122850 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.069327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ab8f-a1c5-49ae-be1a-1b912d122850 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.070227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ab8f-a1c5-49ae-be1a-1b912d122850 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:23.070531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ab8f-a1c5-49ae-be1a-1b912d122850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:23.071971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ab8f-a1c5-49ae-be1a-1b912d122850 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:23.091192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 404/788] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:52:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:23.097714 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:23.225897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:23.265059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ea4d8-9b79-4852-a633-ddeaf47cf067 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:23.319816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fe00a-407a-41fb-991d-cb332c8dc527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:23.320384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fe00a-407a-41fb-991d-cb332c8dc527 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.320679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fe00a-407a-41fb-991d-cb332c8dc527 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.320950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fe00a-407a-41fb-991d-cb332c8dc527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.427345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fe00a-407a-41fb-991d-cb332c8dc527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:23.429387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fe00a-407a-41fb-991d-cb332c8dc527 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:23.544040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de953c1-bc3e-4e98-8159-9727fa662fc0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.544607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de953c1-bc3e-4e98-8159-9727fa662fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.544607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de953c1-bc3e-4e98-8159-9727fa662fc0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.546230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 405/789] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:23.551379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb6cb-41b3-458f-b142-8ba91fa6e5b0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.551661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb6cb-41b3-458f-b142-8ba91fa6e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.551932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb6cb-41b3-458f-b142-8ba91fa6e5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.555925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:23.583516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-222bb6cb-41b3-458f-b142-8ba91fa6e5b0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:23.584657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-222bb6cb-41b3-458f-b142-8ba91fa6e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:23.609263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 385/790] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:23.610669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89a7ba-56a3-4e56-84a9-4f05c2b0c100 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.610947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89a7ba-56a3-4e56-84a9-4f05c2b0c100 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.611217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89a7ba-56a3-4e56-84a9-4f05c2b0c100 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.612786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 386/791] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:23.617362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89a7ba-56a3-4e56-84a9-4f05c2b0c100 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:23.641576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:23.666366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 406/792] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:23.667743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a694969-b467-4139-8272-cc3749619ca5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.668022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a694969-b467-4139-8272-cc3749619ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.668290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a694969-b467-4139-8272-cc3749619ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.688448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4a694969-b467-4139-8272-cc3749619ca5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:23.689678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4a694969-b467-4139-8272-cc3749619ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:23.725767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89a7ba-56a3-4e56-84a9-4f05c2b0c100 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:23.759662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 407/793] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:23.759891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c538d6-ecf1-45a9-80b7-eb1269f36cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:23.760744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c538d6-ecf1-45a9-80b7-eb1269f36cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.761090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c538d6-ecf1-45a9-80b7-eb1269f36cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.761424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c538d6-ecf1-45a9-80b7-eb1269f36cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.762052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c557-e2a0-4038-b217-b483dbbd53af None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.762533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c557-e2a0-4038-b217-b483dbbd53af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.762963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c557-e2a0-4038-b217-b483dbbd53af None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.768627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 408/794] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:23.769408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c557-e2a0-4038-b217-b483dbbd53af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:23.780988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c538d6-ecf1-45a9-80b7-eb1269f36cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:23.782798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c538d6-ecf1-45a9-80b7-eb1269f36cb4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-72c538d6-ecf1-45a9-80b7-eb1269f36cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:23.801654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:23.802824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:23.804083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:23.804083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:23.804083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:23.804083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:23.809943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 387/795] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:23.809943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6407881-d9ca-4047-a5ce-81b695feb2b7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.809943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6407881-d9ca-4047-a5ce-81b695feb2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.809943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6407881-d9ca-4047-a5ce-81b695feb2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.825099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a6407881-d9ca-4047-a5ce-81b695feb2b7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:23.826740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a6407881-d9ca-4047-a5ce-81b695feb2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:23.845120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:23.887950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c557-e2a0-4038-b217-b483dbbd53af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:23.890718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:23.904962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 388/796] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:23.906403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6407881-d9ca-4047-a5ce-81b695feb2b7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:23.926153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:23.926967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:23.927240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:23.927510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:23.938393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:23.946194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:23.947123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 409/797] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:23.953526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.019585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6407881-d9ca-4047-a5ce-81b695feb2b7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.052247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5aede-50bb-46b3-93e0-9e77ccc1d6aa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.062979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.063787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.064071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.064342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.065020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.066397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:24.079176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:24.080148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:24.081022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 389/798] 10.222.0.35 () {56 vars in 1129 bytes} [Thu May 19 11:52:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:24.081863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.096930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.097571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.097846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.098350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.098854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:24.099244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.100528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.102227 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.114061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 410/799] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:24.114688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.139995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.194929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92cb2e-d2a7-4c89-a6d3-840fa979a976 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.215386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf209-2d36-4e4c-9fdc-9c55d5fc6c53 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.231357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.232528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.233052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.233472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.244310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:24.250385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.251249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.251673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.252087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:24.252274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:24.253381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:24.254238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 390/800] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:24.255026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.255940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:24.256377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.257950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.272125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 411/801] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:24.273269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.345444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.365864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.372597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c6c95-f32c-401d-99bf-5e225d50d399 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.383000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4ec6-a084-4ce3-9be9-2938555877be None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.409198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.409950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.410232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.410503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.411225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:24.411527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.413180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.417785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.418576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.423252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.423365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 391/802] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:24.423473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.423572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.429831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.431374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:24.445548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:24.446500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:24.447408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 412/803] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:24.447909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.549278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70bd4-2a4a-4797-ba49-97972a6c735c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.553419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdad4f-0a1a-4621-9b98-29b43cffc916 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.585873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.586543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.586825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.587100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.587845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:24.588152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.589219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.589697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.590012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.590275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.590539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.598367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 392/804] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:24.599061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.603497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.606785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.608384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.617070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:24.628710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:24.629598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:24.630491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:24.630491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:24.630491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:24.630491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:24.630491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 413/805] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:24.630770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.706773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd5f34-39c1-4c79-8dcd-09e23fce1aec None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.739889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eb240-f924-4d5c-b605-c53a4d58a388 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.747311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.747979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.748298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.748564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.749306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:24.749607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.750976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.756061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 393/806] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:24.756938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.783295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.784041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.784369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.784802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.785711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:24.786020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.787578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.804975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 414/807] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:24.804975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.840074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.866715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:24.881920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df26598-be82-4d6c-b645-7e7793a2c01a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.910688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bec765-ab99-4b87-a621-39972246e1dc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:24.916024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.916872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.917149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.917415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.927786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.929307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.943859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:24.944544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:24.944860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:24.945136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:24.945859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:24.945956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:24.946935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:24.947879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:24.947879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:24.947879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:24.947879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:24.948098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:24.948174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 394/808] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:24.948250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:24.948324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:24.960006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 415/809] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:24.960814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.046187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d1fde-204d-4352-aeb3-52d2c2745d85 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.057333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658752b-71c5-440c-91e0-2b5749912925 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.065947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.075762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.081626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.082268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.082542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.082811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.083541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.085007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.092729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7023a6d-3666-4af5-9222-21b9048dbcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.093412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023a6d-3666-4af5-9222-21b9048dbcec None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.093691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023a6d-3666-4af5-9222-21b9048dbcec None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.093964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023a6d-3666-4af5-9222-21b9048dbcec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.094804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7023a6d-3666-4af5-9222-21b9048dbcec None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=7d4f967c85db412aacf6c8b441dbdeb1) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:25.095215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7023a6d-3666-4af5-9222-21b9048dbcec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.097251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7023a6d-3666-4af5-9222-21b9048dbcec None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.103987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 416/810] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:24 2022] GET /identity/v3/role_assignments?user.id=7d4f967c85db412aacf6c8b441dbdeb1&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:25.105252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d839a-07ef-49b5-a464-284a8c156e3f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.105536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d839a-07ef-49b5-a464-284a8c156e3f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.115617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d839a-07ef-49b5-a464-284a8c156e3f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.115898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 395/811] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:25.115898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.116052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 417/812] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:25.116052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d839a-07ef-49b5-a464-284a8c156e3f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.261481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fdca3-02c5-4c5e-b75f-559836f350e0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.266005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d839a-07ef-49b5-a464-284a8c156e3f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.308360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b34db-799e-456b-9089-90142e4fe702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.309440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b34db-799e-456b-9089-90142e4fe702 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.309918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b34db-799e-456b-9089-90142e4fe702 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.310550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b34db-799e-456b-9089-90142e4fe702 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.311593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b34db-799e-456b-9089-90142e4fe702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:25.311735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.312228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b34db-799e-456b-9089-90142e4fe702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.312551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.312853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.313119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.313941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b34db-799e-456b-9089-90142e4fe702 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.325849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.327335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.336317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 396/813] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:25.337929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdad493-7400-4331-84d9-d55839ac1b29 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.338215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdad493-7400-4331-84d9-d55839ac1b29 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.338490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdad493-7400-4331-84d9-d55839ac1b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:25.347117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:25.348108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:25.349101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 418/814] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:25.349685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.357790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ffdad493-7400-4331-84d9-d55839ac1b29 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:25.358997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ffdad493-7400-4331-84d9-d55839ac1b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:25.392220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.398518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.440609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 397/815] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:25.441584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdad493-7400-4331-84d9-d55839ac1b29 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.475825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37505f-079f-4170-a729-b663ed032342 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.519283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.520396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.520719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.520998 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.531332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.532901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:25.549296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:25.550281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:25.551251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:25.553925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 419/816] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:25.555432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.567073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdad493-7400-4331-84d9-d55839ac1b29 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.611589 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.612572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.612937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.613215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.614372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:25.614681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.616664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.640037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 398/817] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:25.641723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.661010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.664606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e02e0-ccad-4c1b-a2a9-cf887b36f78c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.668465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.702541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.703708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.704190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.704683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.705638 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.707290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:25.720054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:25.721125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:52:25.721970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:25.724868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 420/818] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:25.725983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.761946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a3da2-c901-4a8f-bd77-31a8291b17ef None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.804629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.805489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.805768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.806073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.807512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:25.808082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.809874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.832555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 399/819] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:25.833748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.846948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8377b-3301-4f8a-80d5-5dd4a8cd1de8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.887521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.888392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.888796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.889071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.901201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.902672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.920282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:25.922604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:25.923595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:25.924489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:25.924489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:25.924489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:25.924489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:25.924489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 421/820] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:25.928671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:25.944898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:25.947590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb49c-7724-4387-aef5-cfda8214a27d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:25.981903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:25.982669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:25.983097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:25.983428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:25.984143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:25.984445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:25.985856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:25.995680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 400/821] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:25.996559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.038407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a479253-733b-4664-8f55-821eab2bdbfe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.075484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.076365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.076658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.076935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.088924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.091382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.097960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8858c-ccd3-4947-9a9e-39f0c9c473a0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:26.109744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:26.111735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:26.113806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:26.113806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:26.113806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:26.113806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:26.113806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 422/822] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:26.113806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.133502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.134214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.134490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.134753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.135468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:26.135766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.137162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.152890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 401/823] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:26.153747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.156322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:26.190040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:26.231658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bdd9c-f97e-4fcc-86af-39f0d3469350 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.265482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c6e65-9e35-49bb-a8ce-76cc7da81029 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.267491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.268246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.268529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.268875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.269584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:26.269934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.271319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.281386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 423/824] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:26.282421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.299748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.300404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.300707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.300986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.301714 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:26.302020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.303393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.315854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 402/825] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:26.316798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.382805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:26.396111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a1e1-5733-403e-b46c-b6334d8e7cd7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.424117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b74757-247a-474e-b4b6-59a0b89ee8b0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.425632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:26.433160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.434586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.434867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.435138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.449022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.450612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.466955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.467966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.468442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.468938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:26.469111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:26.469958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:26.470861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:26.472533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.474142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.475080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 424/826] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:26.475993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.513435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 403/827] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:26.514731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.692168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46bb12-74da-4ab1-a307-214776fbc701 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.727926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c72cd8-6358-4e98-89db-50e36a6a1b41 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.739322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.740293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.740660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.741012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.744164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:26.749825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.752871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.767340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.768305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.768827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.769279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:26.770172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:26.771037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:26.771918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 425/828] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:26.773097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:26.774460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.775910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.776952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.790526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 404/829] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:26.796279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:26.849069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:26.929335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce55cb-a316-4d86-89db-39d15d66da77 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.933499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c3e2-020b-4df6-9b96-abbafee3529d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:26.971586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9a41f-81ac-4672-8890-5f2f94d379ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.972883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a41f-81ac-4672-8890-5f2f94d379ab None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.973365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a41f-81ac-4672-8890-5f2f94d379ab None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.973771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:26.974099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a41f-81ac-4672-8890-5f2f94d379ab None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/b0ad031f63ba4d449df8f1f78116a890/roles/7e8c2c66c0d84397b4dec3d68ef8105c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.974433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:26.974716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:26.975007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:26.975840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:26.976150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.977629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:26.993373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 426/830] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:26.993726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9a41f-81ac-4672-8890-5f2f94d379ab None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=b0ad031f63ba4d449df8f1f78116a890, role_id=7e8c2c66c0d84397b4dec3d68ef8105c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:26.995281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9a41f-81ac-4672-8890-5f2f94d379ab None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:27.000675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:27.018213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 405/831] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:26 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/b0ad031f63ba4d449df8f1f78116a890/roles/7e8c2c66c0d84397b4dec3d68ef8105c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:52:27.118769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bbd14-9b28-47ae-bbde-14756d42475b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:27.131489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:27.159708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5bba0-3f8a-4a46-91b4-75339d6571b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:27.160618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bba0-3f8a-4a46-91b4-75339d6571b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:27.160923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bba0-3f8a-4a46-91b4-75339d6571b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:27.161196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bba0-3f8a-4a46-91b4-75339d6571b0 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/aa37bb31a4fa42d5937b70c993a994fe/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:27.163317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5bba0-3f8a-4a46-91b4-75339d6571b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=aa37bb31a4fa42d5937b70c993a994fe, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:27.165155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5bba0-3f8a-4a46-91b4-75339d6571b0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:27.181191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 427/832] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:26 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/aa37bb31a4fa42d5937b70c993a994fe/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:52:27.514237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bc05b-4c87-4255-b89a-70163791e5c3 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:27.515096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bc05b-4c87-4255-b89a-70163791e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:27.515606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bc05b-4c87-4255-b89a-70163791e5c3 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:27.517438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 406/833] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:27.523065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218ba0-176d-4dc9-89d5-4a17bfacc352 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:27.523582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218ba0-176d-4dc9-89d5-4a17bfacc352 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:27.524080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218ba0-176d-4dc9-89d5-4a17bfacc352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:27.542094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-24218ba0-176d-4dc9-89d5-4a17bfacc352 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:27.543611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24218ba0-176d-4dc9-89d5-4a17bfacc352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:27.577352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596683a7-177f-4957-8a8c-d2705ceb19bd None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:27.577666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596683a7-177f-4957-8a8c-d2705ceb19bd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:27.577896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596683a7-177f-4957-8a8c-d2705ceb19bd None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:27.579533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 407/834] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:27.584794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9defd-21cc-48f1-94f9-cd5d9c926057 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:27.585087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9defd-21cc-48f1-94f9-cd5d9c926057 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:27.585361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9defd-21cc-48f1-94f9-cd5d9c926057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:27.604827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-81b9defd-21cc-48f1-94f9-cd5d9c926057 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:27.606444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81b9defd-21cc-48f1-94f9-cd5d9c926057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:27.614849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 428/835] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:27.625952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:27.642942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218ba0-176d-4dc9-89d5-4a17bfacc352 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:27.692788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 408/836] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:27.717004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9defd-21cc-48f1-94f9-cd5d9c926057 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:27.771163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:27.776630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218ba0-176d-4dc9-89d5-4a17bfacc352 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:27.827521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:27.829196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:27.829895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:27.830369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:27.831823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:27.833683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:27.842773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9defd-21cc-48f1-94f9-cd5d9c926057 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:27.846075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:27.847056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:27.848116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 429/837] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:27.853004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:27.891965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:27.893110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:27.893525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:27.893935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:27.894727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:27.896820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:27.914493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:27.915657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:27.916703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:27.924683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 409/838] 10.222.0.35 () {56 vars in 1132 bytes} [Thu May 19 11:52:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:27.926213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:27.951765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:27.973108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc122-7f1f-4c44-94a5-1e19aeb14ecc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:28.011811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:28.012842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:28.013132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:28.013405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:28.014391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:28.014702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:28.016252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:28.022632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 430/839] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:28.027193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:28.064281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:28.071408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3dd3-1f3d-4fb8-88f1-9e349dfd9dac None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:28.112341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:28.113035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:28.113317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:28.113588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:28.114561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:28.114561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:28.115964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:28.125285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 410/840] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:28.128691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:28.155815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821df5d-5763-4b1f-9faf-b9d4f8886620 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:28.194724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe456-60d6-4929-98ef-801d6c198b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:28.196069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe456-60d6-4929-98ef-801d6c198b66 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:28.196589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe456-60d6-4929-98ef-801d6c198b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:28.197092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe456-60d6-4929-98ef-801d6c198b66 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:28.198110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe456-60d6-4929-98ef-801d6c198b66 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:28.198705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe456-60d6-4929-98ef-801d6c198b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:28.200318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe456-60d6-4929-98ef-801d6c198b66 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:28.206334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 431/841] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:28.226166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:28.248625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9691f59-4ddc-470b-ab9e-fc39ec02f3ab None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:28.285823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa9d66-d543-4b65-8197-a619bc14c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:28.286931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9d66-d543-4b65-8197-a619bc14c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:28.287438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9d66-d543-4b65-8197-a619bc14c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:28.287958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9d66-d543-4b65-8197-a619bc14c3a3 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:28.288949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa9d66-d543-4b65-8197-a619bc14c3a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:28.289792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa9d66-d543-4b65-8197-a619bc14c3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:28.291492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa9d66-d543-4b65-8197-a619bc14c3a3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:28.304838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 411/842] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:29.296001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cb9db-3338-477a-b6c3-bcfca8e14e2a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.296528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cb9db-3338-477a-b6c3-bcfca8e14e2a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.296528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cb9db-3338-477a-b6c3-bcfca8e14e2a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.298071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 432/843] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:29.303517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050432-b6bb-4005-972f-0fd8d90afb64 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.303913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050432-b6bb-4005-972f-0fd8d90afb64 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.304100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050432-b6bb-4005-972f-0fd8d90afb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.321124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b2050432-b6bb-4005-972f-0fd8d90afb64 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:29.322311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b2050432-b6bb-4005-972f-0fd8d90afb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:29.397427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 412/844] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:29.420757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cb9db-3338-477a-b6c3-bcfca8e14e2a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:29.434525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761cb57-51c9-4701-bc26-f453885fdc3d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.434820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761cb57-51c9-4701-bc26-f453885fdc3d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.435078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761cb57-51c9-4701-bc26-f453885fdc3d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.436727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 413/845] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:29.442184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961da763-912e-4d55-b1a9-bc7bd750a563 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.442498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961da763-912e-4d55-b1a9-bc7bd750a563 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.442731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961da763-912e-4d55-b1a9-bc7bd750a563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.459948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-961da763-912e-4d55-b1a9-bc7bd750a563 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:29.461159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-961da763-912e-4d55-b1a9-bc7bd750a563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:29.537015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:29.548013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cb9db-3338-477a-b6c3-bcfca8e14e2a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:29.548866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 414/846] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:29.566138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961da763-912e-4d55-b1a9-bc7bd750a563 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:29.574594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:29.585381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:29.587059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.587543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.588011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.599505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:29.607920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:29.608866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:52:29.609742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:29.612611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 433/847] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:52:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:29.624672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:29.673834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961da763-912e-4d55-b1a9-bc7bd750a563 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:29.709769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:29.710710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.711090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.711465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.722215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:29.730279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:29.731255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:29.732096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:29.733071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 415/848] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:29.737577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:29.755670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de8cdd-7c58-44c9-82d8-40d24c332123 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:29.800869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:29.801454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.801730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.802255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.803421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:29.803710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:29.805356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:29.806722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:29.817993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 434/849] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:52:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:29.824016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:29.845450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:29.849611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd816c-cd6f-4f49-be1f-1a529bd10efb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:29.891274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:29.892045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.892391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:29.892802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:29.893615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:29.894005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:29.895598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:29.910035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 416/850] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:29.911159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:29.953616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44957ae-b0f3-48e8-b589-dc53c3385b3e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:29.997349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:29.998831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:29.999543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.000018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.015878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.018533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.023478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90241e6e-937c-4f99-b0a1-90000f26ff5f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:30.042785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:30.043892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:30.044877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:30.044877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:30.044877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:30.044877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:30.048816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 435/851] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:30.049738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.063009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.074159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.075267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.076269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.076777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.092260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.094037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:30.120198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:30.121184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:30.122059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:30.122059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:30.122059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:30.122059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:30.123054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.125409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 417/852] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:30.132122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.167423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3147022-7abc-44d7-ad14-4323d1eb7703 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.204007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.204795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.205136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.205472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.206263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:30.206630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.208511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.225973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 436/853] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:30.227292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.239334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b7a73-6878-4d71-b0bf-f20fb6f8a593 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.274041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.275022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.275499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.275975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.276931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:30.277425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.278996 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.292099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 418/854] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:30.297898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.350504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cf656-7ab3-4dce-ae61-85a51f629382 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.356530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.386019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.397425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.398496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.398790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.399042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.408007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.409576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:30.429077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:30.430089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:30.431048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:30.432790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 437/855] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:30.436558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.442299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bca46-04e8-4500-a0c2-a8961c002e98 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.486606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcfd11-2149-4fe7-8f5d-19d87204baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.488243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcfd11-2149-4fe7-8f5d-19d87204baee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.488923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcfd11-2149-4fe7-8f5d-19d87204baee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.489211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcfd11-2149-4fe7-8f5d-19d87204baee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.500124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcfd11-2149-4fe7-8f5d-19d87204baee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.501947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcfd11-2149-4fe7-8f5d-19d87204baee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5dbcfd11-2149-4fe7-8f5d-19d87204baee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:30.522109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:30.523047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:52:30.523987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:30.525960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 419/856] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:30.527202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b165a-d7cd-4ca1-bdc4-2a5d9fd06ee6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.527480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b165a-d7cd-4ca1-bdc4-2a5d9fd06ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.527747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b165a-d7cd-4ca1-bdc4-2a5d9fd06ee6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.529246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 420/857] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:30.536270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04c46-3073-44ab-af21-39f9fbbd1cef None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.536555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04c46-3073-44ab-af21-39f9fbbd1cef None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.536851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04c46-3073-44ab-af21-39f9fbbd1cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.553556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-25f04c46-3073-44ab-af21-39f9fbbd1cef None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:30.554736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-25f04c46-3073-44ab-af21-39f9fbbd1cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:30.564540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff18f9-279a-45dc-8c6b-3681a7a3d341 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.600915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.601506 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.601782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.602050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.602887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:30.603193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.604621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.622622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 438/858] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:30.623439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.632658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 421/859] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:30.636002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12054-771b-4f78-bdb3-5c806d1dd9df None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.636002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12054-771b-4f78-bdb3-5c806d1dd9df None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.636002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12054-771b-4f78-bdb3-5c806d1dd9df None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.636002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 422/860] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:30.636438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12054-771b-4f78-bdb3-5c806d1dd9df None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.667066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.675527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.728453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e912373-9705-4910-8809-f931099c4ad4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.738894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12054-771b-4f78-bdb3-5c806d1dd9df None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:30.762009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a385c8-1bd9-42d1-86e9-c60e8ba25279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.762679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a385c8-1bd9-42d1-86e9-c60e8ba25279 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.762957 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a385c8-1bd9-42d1-86e9-c60e8ba25279 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.763252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a385c8-1bd9-42d1-86e9-c60e8ba25279 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.764097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a385c8-1bd9-42d1-86e9-c60e8ba25279 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:30.764402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a385c8-1bd9-42d1-86e9-c60e8ba25279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.765878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a385c8-1bd9-42d1-86e9-c60e8ba25279 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.773963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:30.774595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.774875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.775145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.782755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 439/861] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:30.783981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f564-4be4-4d91-947b-0c705d8ff191 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:30.784268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f564-4be4-4d91-947b-0c705d8ff191 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:30.784542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f564-4be4-4d91-947b-0c705d8ff191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:30.800515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-05b6f564-4be4-4d91-947b-0c705d8ff191 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:30.801799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05b6f564-4be4-4d91-947b-0c705d8ff191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:30.848665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:30.850185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:30.869395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 440/862] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:30.870147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f564-4be4-4d91-947b-0c705d8ff191 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.879305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.918170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:30.956111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 423/863] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:30.956988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:30.990634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f564-4be4-4d91-947b-0c705d8ff191 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.024344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.025049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.025324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.025598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.026322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.027699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.042996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 441/864] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:30 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:31.043779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.054147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb9c1-3cd4-4eae-a73d-1bf9bc6a8e53 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.089455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:31.105132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.105887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.106173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.106445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.155005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:31.164851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7efe56-cb38-4537-8eb4-2a8901c338e0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.186923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.188426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.211909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.212584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.212899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.213175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.213912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.215327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.240682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 442/865] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:31 2022] POST /identity/v3/services => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:31.240682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.327579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 424/866] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:30 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:31.333223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.362088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:31.374809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f7ea6-4485-4658-a1b3-5b56bd16d819 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.420716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.421464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.421742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.422113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.433970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.435436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.445902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:31.446062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e53a-9170-4db4-afd4-e91afa962da8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:31.457661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:31.458617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:31.460014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:31.460014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:31.460014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:31.460014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:31.460014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 443/867] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:31.464804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.502938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.502938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.502938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.502938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.514717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.516176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:31.534382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:31.535362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:31.536282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:31.536282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:31.536282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:31.536282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:31.540550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 425/868] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:31.541760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.614897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca44a3-404b-4ab6-b937-1d582527b4b3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.627311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:31.648605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ad9b0-3b0f-4942-8204-ede386def240 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.660860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.661854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.662503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.663376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.664910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:31.665424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.667425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.687687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 444/869] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:31.688262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.688966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.689420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.689681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.689793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.690463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:31.690767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.692194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.709552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 426/870] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:31.710909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.762597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:31.807118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e0a8-d365-4c61-86a3-172e7097152a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.816148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5deff-1859-4474-9a75-95aaf6b7c9cb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:31.842958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.844281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.845049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.845792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.852715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:31.853522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:31.853798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:31.854066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:31.855732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.858023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.862822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:31.864265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:31.874827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:31.875723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:31.876657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:31.883398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:31.884283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:31.885203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:31.885686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 427/871] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:31.886224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.886725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 445/872] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:31.888117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:31.996200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b527f-d80f-4d92-be9e-729a0309f634 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:32.013237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d38df-67a1-4860-a409-3156b3c493fe None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:32.030929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:32.031926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:32.032037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:32.032270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:32.033140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:32.033496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:32.034895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:32.049093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:32.052836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 446/873] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:32.054295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:32.055672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:32.056546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:32.057045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:32.057663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:32.059482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:32.059979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:32.061644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:32.080130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 428/874] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:32.081848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:32.163021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:32.178254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43564e72-790f-4d9c-976c-212d04f25cf8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:32.209758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8a09b-828a-4a88-a488-02db5dfe578e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:32.224655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6a0b6-b7cb-4217-9b56-84adffaac025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:32.225712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a0b6-b7cb-4217-9b56-84adffaac025 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:32.226082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a0b6-b7cb-4217-9b56-84adffaac025 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:32.226263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a0b6-b7cb-4217-9b56-84adffaac025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:32.227110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6a0b6-b7cb-4217-9b56-84adffaac025 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=aa37bb31a4fa42d5937b70c993a994fe) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:32.227418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6a0b6-b7cb-4217-9b56-84adffaac025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:32.228991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6a0b6-b7cb-4217-9b56-84adffaac025 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:32.241204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 447/875] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:32 2022] GET /identity/v3/role_assignments?user.id=aa37bb31a4fa42d5937b70c993a994fe&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:32.252881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029129-11f1-4b1f-b779-0367f881ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:32.253970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029129-11f1-4b1f-b779-0367f881ff20 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:32.254444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029129-11f1-4b1f-b779-0367f881ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:32.254928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029129-11f1-4b1f-b779-0367f881ff20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:32.255986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029129-11f1-4b1f-b779-0367f881ff20 None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=b0ad031f63ba4d449df8f1f78116a890) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:32.256580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029129-11f1-4b1f-b779-0367f881ff20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:32.258552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029129-11f1-4b1f-b779-0367f881ff20 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:32.266547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 429/876] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:32 2022] GET /identity/v3/role_assignments?user.id=b0ad031f63ba4d449df8f1f78116a890&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:33.314035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f283-0823-46df-b094-dc802a6478b6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:33.314564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f283-0823-46df-b094-dc802a6478b6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:33.314564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f283-0823-46df-b094-dc802a6478b6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:33.316078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 448/877] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:33.321578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408ad01-c2b4-4696-96a9-f83ab3e5cfd9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:33.322382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408ad01-c2b4-4696-96a9-f83ab3e5cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:33.322932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408ad01-c2b4-4696-96a9-f83ab3e5cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:33.340319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0408ad01-c2b4-4696-96a9-f83ab3e5cfd9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:33.341821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0408ad01-c2b4-4696-96a9-f83ab3e5cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:33.417665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 430/878] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:33.440166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f283-0823-46df-b094-dc802a6478b6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:33.492019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:33.556343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f283-0823-46df-b094-dc802a6478b6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:33.573199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77c2de-760f-4268-8cb7-0ad95bbf6bbb None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:33.573398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77c2de-760f-4268-8cb7-0ad95bbf6bbb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:33.573656 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77c2de-760f-4268-8cb7-0ad95bbf6bbb None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:33.576420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 431/879] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:33.580506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2433ec2-5a0b-47c1-8382-8183fa152335 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:33.580831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2433ec2-5a0b-47c1-8382-8183fa152335 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:33.581106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2433ec2-5a0b-47c1-8382-8183fa152335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:33.595343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:33.596465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:33.596976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:33.597452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:33.598409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:33.598699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c2433ec2-5a0b-47c1-8382-8183fa152335 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:33.599887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c2433ec2-5a0b-47c1-8382-8183fa152335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:33.600460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:33.616745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:33.617818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:33.618671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:33.621671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 449/880] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:33.629575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:33.653485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:33.680758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 432/881] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:33.699713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2433ec2-5a0b-47c1-8382-8183fa152335 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:33.731580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e419f6-f7c9-4302-b1e4-4dcda86a88c9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:33.740869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:33.774981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:33.776050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:33.776738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:33.777098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:33.778817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:33.779226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:33.780737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:33.788716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 450/882] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:33.794574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:33.839215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2433ec2-5a0b-47c1-8382-8183fa152335 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:33.906223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:33.907038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:33.907315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:33.907580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:33.908234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:33.909629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:33.934508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:33.935520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:33.936364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:33.944074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 433/883] 10.222.0.35 () {56 vars in 1132 bytes} [Thu May 19 11:52:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:33.952390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.005786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9befd-63d2-454c-a506-68291644c98e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.045654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:34.065544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.066222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.066499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.066775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.067490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:34.067850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.069366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.080485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 451/884] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:34.081985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.125645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:34.175291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70340-edfd-4b25-92da-76736af3c157 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.211025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.211692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.211969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.212237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.212977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:34.213279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.214713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.225115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 434/885] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:34.226466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.265528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb837034-937a-435d-b322-3289b7bce75e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.335442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.336529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48f64d-1d86-4282-82a9-59d7732ab7b0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.337822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.338501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.338970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.340013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] RBAC: Adding query filter params (interface=public, service_id=a9995dc54c944fe4ad8ba75e8670b886, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:34.340549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.342492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.349155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:34.356986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 452/886] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/endpoints?service_id=a9995dc54c944fe4ad8ba75e8670b886&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:34.359512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.387086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.387779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.388063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.388410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.389085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:34.392020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.393709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.405045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 435/887] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:34.406524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.471898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:34.475183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd950f-f004-4c20-980c-a54aaed7781a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.514189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4113-5fa7-44f1-b4c7-af0c13a44be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.515136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4113-5fa7-44f1-b4c7-af0c13a44be9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.515596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4113-5fa7-44f1-b4c7-af0c13a44be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.516044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4113-5fa7-44f1-b4c7-af0c13a44be9 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.517100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4113-5fa7-44f1-b4c7-af0c13a44be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.518767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4113-5fa7-44f1-b4c7-af0c13a44be9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.532929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945d6c6-7eae-4a7f-b255-b698c4928333 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.533265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 453/888] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:52:34.543541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe65f2f-4730-4e93-81e8-0a416a28be32 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.543860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe65f2f-4730-4e93-81e8-0a416a28be32 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.544087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe65f2f-4730-4e93-81e8-0a416a28be32 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.545750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 454/889] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:34.553872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7d6d6-1235-4ccc-a36b-68c06bf59c64 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.554188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7d6d6-1235-4ccc-a36b-68c06bf59c64 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.554413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7d6d6-1235-4ccc-a36b-68c06bf59c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.567868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3744-eecd-422b-b518-9466763d0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.568548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3744-eecd-422b-b518-9466763d0c47 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.568956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3744-eecd-422b-b518-9466763d0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.569233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3744-eecd-422b-b518-9466763d0c47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.570156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b3744-eecd-422b-b518-9466763d0c47 None admin] RBAC: Adding query filter params (interface=public, service_id=9c03b7cf07bd4696984972b1d0bc3558, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:34.570476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b3744-eecd-422b-b518-9466763d0c47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.571910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b3744-eecd-422b-b518-9466763d0c47 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.575902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-02c7d6d6-1235-4ccc-a36b-68c06bf59c64 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:34.577707 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02c7d6d6-1235-4ccc-a36b-68c06bf59c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:34.583501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 436/890] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/endpoints?service_id=9c03b7cf07bd4696984972b1d0bc3558&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:34.585488 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a573d44-c2bc-49fc-9b4f-7bf3dce0b4f8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.585960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a573d44-c2bc-49fc-9b4f-7bf3dce0b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.586233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a573d44-c2bc-49fc-9b4f-7bf3dce0b4f8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.587742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 437/891] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:34.588314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a573d44-c2bc-49fc-9b4f-7bf3dce0b4f8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.638320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:34.668956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 455/892] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:34.670754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cecd25-5c1c-47d7-a3da-b94800fa778d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.671200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cecd25-5c1c-47d7-a3da-b94800fa778d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.671894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cecd25-5c1c-47d7-a3da-b94800fa778d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.693683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82cecd25-5c1c-47d7-a3da-b94800fa778d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:34.695145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82cecd25-5c1c-47d7-a3da-b94800fa778d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:34.712321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a573d44-c2bc-49fc-9b4f-7bf3dce0b4f8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.750730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.751462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.751733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.751999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.752703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.754177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.760632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 438/893] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:52:34.760632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.774939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 456/894] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:34.798129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cecd25-5c1c-47d7-a3da-b94800fa778d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.831923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:34.898238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dc3e1-9c31-48e1-a3f3-4fe6b6590ce8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.899869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:34.926342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cecd25-5c1c-47d7-a3da-b94800fa778d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:34.957467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.957467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.957467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.957467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.958150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:34.959918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:34.971289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:34.972093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:34.972372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:34.972658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:34.974082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:34.975095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:34.975969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:34.977526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 439/895] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:34.983688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:34.991675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:35.000309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:35.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:35.002374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 457/896] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:35.009789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:35.090691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662424f-e070-4873-afbf-2d849fa2fc21 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:35.111336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:35.125812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:35.126544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:35.126819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:35.127130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:35.127833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:35.128132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:35.129293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c902b15-7109-4679-8ef6-1641d77a8f96 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:35.129561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:35.139389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 440/897] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:35.140196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:35.164830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:35.165446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:35.165722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:35.165996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:35.166757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:35.167048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:35.168417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:35.172812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:35.177805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 458/898] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 11:52:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:35.183389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:35.245958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f77247-88ed-4548-af94-8afc537ad347 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:35.280421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:35.281119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:35.281393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:35.281662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:35.282417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:35.282720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:35.284094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:35.291725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae3bf-1701-4852-9624-d6bbf96b4860 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:35.296951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 441/899] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:35.332995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:35.333985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:35.334434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:35.334714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:35.347063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:35.348559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:35.356749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:35.370722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:35.373005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:35.375078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:35.375078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:35.375078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:35.375078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:35.375078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 459/900] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:35.381723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:35.486147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:35.493873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424206d0-d768-4c8b-b576-fddb6aa887a2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:35.533491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:35.534413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:35.534838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:35.535249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:35.536105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:35.536576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:35.538141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:35.555598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 442/901] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:35.559603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:35.668128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8963-2499-439f-9a61-4cd13d12d858 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:35.703144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:35.704269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:35.704754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:35.705203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:35.713602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:35.715286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:35.730122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:35.731057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:35.732010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:35.738566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 460/902] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:52:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:35.740070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:35.862404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75c24-8b23-4a82-985b-8feac732a404 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:35.896961 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:35.897624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:35.897899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:35.898165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:35.898994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:35.899293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:35.900734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:35.919078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 443/903] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 11:52:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:35.924990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:35.985989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:36.036749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7fc0-6e4f-4411-96f9-a44473f5e3a5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:36.071544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:36.072206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:36.072487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:36.072786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:36.144375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:36.145876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:36.205994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:36.249890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 461/904] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:36.255824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:36.270900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:36.359794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112e4fc-a625-4b3d-b1ab-2ca3fb706ff3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:36.395938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:36.397508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:36.397945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:36.398367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:36.409275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:36.410966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:36.429690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:36.430855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:36.431982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:36.431982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:36.431982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:36.431982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:36.434077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 444/905] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:36.440691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:36.547731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c7af-7bd4-4ece-968e-d65f6b428a16 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:36.583097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:36.583762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:36.584043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:36.584351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:36.585115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:36.585422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:36.586829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:36.600753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 462/906] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:36.606123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:36.670934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:36.712580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cafd-7094-4985-a440-7bf928767c03 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:36.746889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729faa-595b-4fe6-84ec-c7ef4678d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:36.747913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729faa-595b-4fe6-84ec-c7ef4678d28b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:36.748332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729faa-595b-4fe6-84ec-c7ef4678d28b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:36.748768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729faa-595b-4fe6-84ec-c7ef4678d28b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:36.755768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70729faa-595b-4fe6-84ec-c7ef4678d28b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:36.757496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70729faa-595b-4fe6-84ec-c7ef4678d28b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-70729faa-595b-4fe6-84ec-c7ef4678d28b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:36.771869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:36.772957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:36.774065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:36.776166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 445/907] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:36.781891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:36.803393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2f98-7330-40a7-8bea-c8ff03e8e4b4 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:36.803906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2f98-7330-40a7-8bea-c8ff03e8e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:36.804349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2f98-7330-40a7-8bea-c8ff03e8e4b4 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:36.805381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:36.806329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 446/908] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:36.811516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becff5e-27e3-47db-ac27-e23e242d8e6e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:36.811966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becff5e-27e3-47db-ac27-e23e242d8e6e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:36.812378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becff5e-27e3-47db-ac27-e23e242d8e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:36.829573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6becff5e-27e3-47db-ac27-e23e242d8e6e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:36.830953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6becff5e-27e3-47db-ac27-e23e242d8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:36.904840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4caf39-a747-46ff-b5ea-1b855dc37f6c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:36.905147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 447/909] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:36.921541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becff5e-27e3-47db-ac27-e23e242d8e6e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:36.945090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:36.946069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:36.946342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:36.947739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:36.949287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:36.949287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:36.950762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:36.977008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 463/910] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:36.979521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:36.996389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.046986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becff5e-27e3-47db-ac27-e23e242d8e6e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.081312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.083143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.084029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.084595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.085151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.086157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.087960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:37.100298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:37.101568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:52:37.102620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:37.108734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 448/911] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:37.110054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6388e7-8419-4325-8203-07e3d89d790b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.110526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.153358 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71879dba-0555-415e-a168-5bf539e36040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.154657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879dba-0555-415e-a168-5bf539e36040 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.155086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879dba-0555-415e-a168-5bf539e36040 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.155826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879dba-0555-415e-a168-5bf539e36040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.157188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71879dba-0555-415e-a168-5bf539e36040 None admin] RBAC: Adding query filter params (role.id=0d8ba816c5924e298c6b02aa4ed28600, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=b0ad031f63ba4d449df8f1f78116a890) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:37.157666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71879dba-0555-415e-a168-5bf539e36040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.159801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71879dba-0555-415e-a168-5bf539e36040 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.168212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 464/912] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:36 2022] GET /identity/v3/role_assignments?user.id=b0ad031f63ba4d449df8f1f78116a890&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=0d8ba816c5924e298c6b02aa4ed28600 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:37.169741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c36e8-baed-4ee1-9ef9-a097010d30ee None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.170100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c36e8-baed-4ee1-9ef9-a097010d30ee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.170475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c36e8-baed-4ee1-9ef9-a097010d30ee None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.171933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 465/913] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:37.177544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29870c-7477-41c9-951e-4fe966a06a98 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.178252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29870c-7477-41c9-951e-4fe966a06a98 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.178992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29870c-7477-41c9-951e-4fe966a06a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.199212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0f29870c-7477-41c9-951e-4fe966a06a98 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:37.200897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0f29870c-7477-41c9-951e-4fe966a06a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:37.227712 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdebd-d56c-457f-80ae-4af9518065a4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.248017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.268383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.269100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.269375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.269643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.270358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:37.270660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.272103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.282083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 449/914] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:37.283286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.298291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 466/915] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:37.321630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29870c-7477-41c9-951e-4fe966a06a98 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.403305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.412307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd019-4a46-41f4-b908-8cccfc65e20d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.441234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29870c-7477-41c9-951e-4fe966a06a98 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.449051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.449982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.450464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.450934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.451854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:37.452358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.453972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.464344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 450/916] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 11:52:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:37.465634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.485092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.485915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.486197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.486470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.487126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.488514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:37.502637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:37.503631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:52:37.504465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:37.514882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 467/917] 10.222.0.35 () {56 vars in 1132 bytes} [Thu May 19 11:52:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:37.521833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.532115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.591182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79346179-9fed-4741-97e2-deef3674d257 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.625983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dd940-1b55-459f-997f-437a226b84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.626636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dd940-1b55-459f-997f-437a226b84ce None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.626907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dd940-1b55-459f-997f-437a226b84ce None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.627175 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dd940-1b55-459f-997f-437a226b84ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.627900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dd940-1b55-459f-997f-437a226b84ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.629293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dd940-1b55-459f-997f-437a226b84ce None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.632360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26d907-7ffe-4be3-b3bb-8d2d5399a61b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.649478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 451/918] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:37.651081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c45bc-9e3e-41d5-b6aa-a5568c3299f1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.651537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c45bc-9e3e-41d5-b6aa-a5568c3299f1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.651977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c45bc-9e3e-41d5-b6aa-a5568c3299f1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.653775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 452/919] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:37.660682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63110-5cdb-4e13-ad66-6fa2c000de47 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.661281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63110-5cdb-4e13-ad66-6fa2c000de47 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.662591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63110-5cdb-4e13-ad66-6fa2c000de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.683812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.686541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-56f63110-5cdb-4e13-ad66-6fa2c000de47 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:37.688323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-56f63110-5cdb-4e13-ad66-6fa2c000de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:37.690272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.691465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.691948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.692434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.693444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:37.693994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.695602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.706339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 468/920] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:37.707618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.784063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 453/921] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:37.812219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63110-5cdb-4e13-ad66-6fa2c000de47 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.836574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdedcd-c372-49bd-a236-3f279a95b600 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.845592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.882725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.883786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.884260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.884737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.885601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:37.885903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.887287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.895413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 469/922] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:37.901680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:37.934795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63110-5cdb-4e13-ad66-6fa2c000de47 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:37.972771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:37.974668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f130f3-0818-4505-86fc-2d965c98067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:37.975440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f130f3-0818-4505-86fc-2d965c98067a None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:37.975741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f130f3-0818-4505-86fc-2d965c98067a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:37.976000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f130f3-0818-4505-86fc-2d965c98067a None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:37.976781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f130f3-0818-4505-86fc-2d965c98067a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:37.978749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f130f3-0818-4505-86fc-2d965c98067a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:37.995428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 454/923] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:37 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:38.025030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78011-4275-437c-b986-0b9e10473eb8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:38.071226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858411-f4e5-4897-a635-23f679247a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:38.071899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858411-f4e5-4897-a635-23f679247a31 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:38.072177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858411-f4e5-4897-a635-23f679247a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:38.072447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858411-f4e5-4897-a635-23f679247a31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:38.073239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858411-f4e5-4897-a635-23f679247a31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:38.074630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858411-f4e5-4897-a635-23f679247a31 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:38.100128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 470/924] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:52:39.442051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d144-2576-4bcc-99ae-28998b6037b0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:39.442571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d144-2576-4bcc-99ae-28998b6037b0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:39.442571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d144-2576-4bcc-99ae-28998b6037b0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:39.444249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 455/925] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:39.449376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e16db-9c83-4dd3-8508-406dd0230c2f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:39.449786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e16db-9c83-4dd3-8508-406dd0230c2f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:39.449956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e16db-9c83-4dd3-8508-406dd0230c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:39.467228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-490e16db-9c83-4dd3-8508-406dd0230c2f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:39.468411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-490e16db-9c83-4dd3-8508-406dd0230c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:39.543520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 471/926] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:39.565476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6d144-2576-4bcc-99ae-28998b6037b0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:39.658974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:39.668854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6d144-2576-4bcc-99ae-28998b6037b0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:39.705182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:39.705904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:39.706180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:39.706451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:39.717061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:39.725142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:39.726066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:39.726896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 456/927] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 11:52:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:39.732478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e16db-9c83-4dd3-8508-406dd0230c2f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:39.776921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:39.840850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e16db-9c83-4dd3-8508-406dd0230c2f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:39.875588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505873-04d3-4c52-a7ac-f4b12d89382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:39.876260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505873-04d3-4c52-a7ac-f4b12d89382a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:39.876538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505873-04d3-4c52-a7ac-f4b12d89382a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:39.876840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505873-04d3-4c52-a7ac-f4b12d89382a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:39.877590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505873-04d3-4c52-a7ac-f4b12d89382a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:39.877892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505873-04d3-4c52-a7ac-f4b12d89382a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:39.879271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505873-04d3-4c52-a7ac-f4b12d89382a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:39.888097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 472/928] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 11:52:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:39.893856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:39.947820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ede4b-8827-4989-b2e0-39cf6e22efab None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:39.948145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ede4b-8827-4989-b2e0-39cf6e22efab None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:39.948360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ede4b-8827-4989-b2e0-39cf6e22efab None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:39.950007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 473/929] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:39.954937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeab55-8a42-40d4-8ac2-460c12e17246 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:39.955276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeab55-8a42-40d4-8ac2-460c12e17246 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:39.955612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeab55-8a42-40d4-8ac2-460c12e17246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:39.974229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7ebeab55-8a42-40d4-8ac2-460c12e17246 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:39.976081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ebeab55-8a42-40d4-8ac2-460c12e17246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:39.998543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aef19-3006-4526-b320-7f62e4d201a0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.034324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.035116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.035479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.035745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.048077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.049699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.053735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 474/930] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:40.079372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeab55-8a42-40d4-8ac2-460c12e17246 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:40.081609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:40.082484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:40.083380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:40.083380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:40.083380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:40.083380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:40.085895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 457/931] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:40.093866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.100070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.119912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.196880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeab55-8a42-40d4-8ac2-460c12e17246 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.211404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946eeef-9948-4ea1-9ad4-2fa72db956a2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.239210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.239810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.240093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.240404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.241182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.242691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.244228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING keystone.server.flask.common [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 11:52:40.251651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.252629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.253185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.253660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.254667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:40.255175 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.256905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.264156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:52:40.264156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 11:52:40.264156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [parameters: {'id': '21a452e486b84f5494c0a51063a4b0b8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 11:52:40.264156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:52:40.271020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 458/932] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:40.277825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e78eaebf-783b-4bb8-b8ac-85c531ebf6ba None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21a452e486b84f5494c0a51063a4b0b8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21a452e486b84f5494c0a51063a4b0b8. May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:52:40.285893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 11:52:40.286758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() May 19 11:52:40.287782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:52:40.289583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:52:40.290465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:52:40.291318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'id': '21a452e486b84f5494c0a51063a4b0b8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.293217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:40.295112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21a452e486b84f5494c0a51063a4b0b8. May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 475/933] 10.222.0.35 () {60 vars in 1140 bytes} [Thu May 19 11:52:40 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47317e7-f3ca-4d65-a9d0-b1b539b523a8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.297287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47317e7-f3ca-4d65-a9d0-b1b539b523a8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.298817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47317e7-f3ca-4d65-a9d0-b1b539b523a8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.305396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 476/934] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:40.305396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47317e7-f3ca-4d65-a9d0-b1b539b523a8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.343689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.384312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6502-dd70-4bb2-967f-b8271b3a0802 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.390156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.407263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47317e7-f3ca-4d65-a9d0-b1b539b523a8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.418734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc7813-f13c-4808-9aee-c7b1aac92c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.419527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc7813-f13c-4808-9aee-c7b1aac92c09 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.419804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc7813-f13c-4808-9aee-c7b1aac92c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.420074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc7813-f13c-4808-9aee-c7b1aac92c09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.427402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc7813-f13c-4808-9aee-c7b1aac92c09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.428911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc7813-f13c-4808-9aee-c7b1aac92c09 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.442624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ccab6-5eef-4480-9efc-320f1c8f710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.443480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ccab6-5eef-4480-9efc-320f1c8f710f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.443740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ccab6-5eef-4480-9efc-320f1c8f710f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6ccc7813-f13c-4808-9aee-c7b1aac92c09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:40.443872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:40.445432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:40.446763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:40.447415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ccab6-5eef-4480-9efc-320f1c8f710f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.447508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 459/935] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:40.447508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe5dc8-25c4-4abc-b55b-c8aee39e7e43 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.447508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe5dc8-25c4-4abc-b55b-c8aee39e7e43 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.447508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe5dc8-25c4-4abc-b55b-c8aee39e7e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.455143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ccab6-5eef-4480-9efc-320f1c8f710f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.457009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ccab6-5eef-4480-9efc-320f1c8f710f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.462872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-effe5dc8-25c4-4abc-b55b-c8aee39e7e43 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:40.464016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-effe5dc8-25c4-4abc-b55b-c8aee39e7e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-616ccab6-5eef-4480-9efc-320f1c8f710f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:40.471332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:40.472343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.473289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 477/936] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:40.473767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866873ff-84ee-443e-9389-a2f0c327a3b8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.473995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866873ff-84ee-443e-9389-a2f0c327a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.474258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866873ff-84ee-443e-9389-a2f0c327a3b8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.475603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 478/937] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:40.476277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866873ff-84ee-443e-9389-a2f0c327a3b8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.537492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 460/938] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:40.538633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe5dc8-25c4-4abc-b55b-c8aee39e7e43 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.584377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866873ff-84ee-443e-9389-a2f0c327a3b8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.595775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.618355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e494897-eb16-4b20-b747-650b511ebad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.618995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e494897-eb16-4b20-b747-650b511ebad7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.619302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e494897-eb16-4b20-b747-650b511ebad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.619562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e494897-eb16-4b20-b747-650b511ebad7 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.620399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e494897-eb16-4b20-b747-650b511ebad7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:40.620729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e494897-eb16-4b20-b747-650b511ebad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.622166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e494897-eb16-4b20-b747-650b511ebad7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.639336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe5dc8-25c4-4abc-b55b-c8aee39e7e43 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.639590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 479/939] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:40.640877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71c41-dd9c-4d68-b695-ba2da06c6333 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.641158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71c41-dd9c-4d68-b695-ba2da06c6333 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.641429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca71c41-dd9c-4d68-b695-ba2da06c6333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.647141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.658235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cca71c41-dd9c-4d68-b695-ba2da06c6333 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:40.659725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cca71c41-dd9c-4d68-b695-ba2da06c6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:40.678483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.680077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.680363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.680621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.681399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:40.681698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.683103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.703780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 461/940] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:40.704770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.738610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 480/941] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:40.739328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca71c41-dd9c-4d68-b695-ba2da06c6333 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.841287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7f4a2-2f38-42bd-ae0e-facafd4f867e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.850701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca71c41-dd9c-4d68-b695-ba2da06c6333 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:40.857642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.881368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.882173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.882453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.882728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.883384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.884818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.890185 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:40.891041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:40.891324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:40.891595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:40.893742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:40.897548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:40.898681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:40.899532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 462/942] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:40.900305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:40.904965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:40.906880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:40.928378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:40.929391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:40.930274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:40.930274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:40.930274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:40.930274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:40.930274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 481/943] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:40.930558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.019645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1aff0-0897-4d4f-ac79-47fca799797f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.050236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8946d9-e628-453d-b00c-c5291cd664c0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.055001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.055805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.056085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.056355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.057034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.058413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:41.070862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:41.071934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:41.072800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:41.077451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 463/944] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:41.078126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.089438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.090456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.090740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.091012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.092027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:41.092521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.093917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.100161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 482/945] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:41.100983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.127454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:41.157816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:41.187797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df435-92ea-408e-838f-10de2886f4ba None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.214171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867de54-3dbb-45d9-a459-77e33cea3ff6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.226249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.226915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.227191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.227700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.228900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:41.229213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.230731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.242961 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 464/946] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:41.243594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.254873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.256027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.256360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.256704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.258286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:41.258661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.260701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.272048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 483/947] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:41.272048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.351857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14530468-c3d4-4fa8-a717-949c60f319a3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.353646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:41.390262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757c801-e31b-423c-94c2-9f4cb264241c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.397770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.398838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.399128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.399406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.400120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:41.400800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.402506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.405569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:41.412569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 465/948] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:41.412569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.433826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.435129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.435414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.435681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.442860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.444348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:41.458655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:41.460070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:41.461047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:41.464906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 484/949] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:41.465846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.527390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0720a-066c-451a-83b2-5ee4c2a2ec85 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.563089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.563743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.564023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.564293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.565034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:41.565335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.566690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.570186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6750dc-5b62-4aef-8a4f-bbdd9cf46eed None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.571376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 466/950] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:41.573515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.610760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.611436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.611713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.611983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.612830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] RBAC: Adding query filter params (interface=public, service_id=d503a2bdf37547b8b94e0c830807fd7d, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:41.613152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.614568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.625584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 485/951] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/endpoints?service_id=d503a2bdf37547b8b94e0c830807fd7d&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:41.626593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.630065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:41.673176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:41.732122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6eaf-97e6-4e40-b9f7-e1feb609e36f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.760895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def09563-af06-4d43-8858-23a9b85a97f7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.772463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.773579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.773954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.774320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.775275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:41.775672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.777340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.790941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 467/952] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:41.796997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:41.805346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8bfd4-a57e-452b-ac24-64d2778f93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.806093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8bfd4-a57e-452b-ac24-64d2778f93a4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.806436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8bfd4-a57e-452b-ac24-64d2778f93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.806776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8bfd4-a57e-452b-ac24-64d2778f93a4 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.807528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8bfd4-a57e-452b-ac24-64d2778f93a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.809053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8bfd4-a57e-452b-ac24-64d2778f93a4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.815830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 486/953] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:41 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:52:41.910024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:41.926518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d67d6-80a7-46e8-bc9b-e736863c1303 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:41.964079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0cc9e-c876-4071-8400-a8957f85f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:41.965449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0cc9e-c876-4071-8400-a8957f85f841 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:41.965932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0cc9e-c876-4071-8400-a8957f85f841 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:41.966418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0cc9e-c876-4071-8400-a8957f85f841 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/b0ad031f63ba4d449df8f1f78116a890/roles/0d8ba816c5924e298c6b02aa4ed28600` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:41.969050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0cc9e-c876-4071-8400-a8957f85f841 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=b0ad031f63ba4d449df8f1f78116a890, role_id=0d8ba816c5924e298c6b02aa4ed28600)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:41.970735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0cc9e-c876-4071-8400-a8957f85f841 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:41.989543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 468/954] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:41 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/b0ad031f63ba4d449df8f1f78116a890/roles/0d8ba816c5924e298c6b02aa4ed28600 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:52:42.957639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323c98c-5c50-4bbe-8fd3-0bf7024db99a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:42.958203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323c98c-5c50-4bbe-8fd3-0bf7024db99a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:42.958203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323c98c-5c50-4bbe-8fd3-0bf7024db99a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:42.959826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 487/955] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:42.965182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455eb74-fa96-4341-a3e2-50326c66f0ae None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:42.965569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455eb74-fa96-4341-a3e2-50326c66f0ae None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:42.965799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455eb74-fa96-4341-a3e2-50326c66f0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:42.983325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d455eb74-fa96-4341-a3e2-50326c66f0ae None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:42.984494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d455eb74-fa96-4341-a3e2-50326c66f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:43.053650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 469/956] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:43.077325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323c98c-5c50-4bbe-8fd3-0bf7024db99a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:43.188030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323c98c-5c50-4bbe-8fd3-0bf7024db99a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:43.189575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:43.223772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:43.224383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:43.224709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:43.224991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:43.225706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:43.227163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:43.241753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:52:43.241753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 11:52:43.241753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [parameters: {'user_id': '5a9bca34e82f4e38adf3b784df2da65e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 11:52:43.241753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() May 19 11:52:43.249658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:52:43.250559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:52:43.251611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:52:43.252509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:52:43.253479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:52:43.254365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'user_id': '5a9bca34e82f4e38adf3b784df2da65e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:43.255228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 11:52:43.256108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 11:52:43.258782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 11:52:43.258782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 11:52:43.258782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:52:43.258782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:52:43.258782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 11:52:43.258782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:43.258782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 488/957] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 11:52:43 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:43.259733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455eb74-fa96-4341-a3e2-50326c66f0ae None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:43.341143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:43.362152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455eb74-fa96-4341-a3e2-50326c66f0ae None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:43.399040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec159b2-593e-42f9-8654-e69fbe4ac7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:43.400207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec159b2-593e-42f9-8654-e69fbe4ac7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:43.400721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec159b2-593e-42f9-8654-e69fbe4ac7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:43.401216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec159b2-593e-42f9-8654-e69fbe4ac7b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:43.409050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec159b2-593e-42f9-8654-e69fbe4ac7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:43.410742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec159b2-593e-42f9-8654-e69fbe4ac7b0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3ec159b2-593e-42f9-8654-e69fbe4ac7b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:43.426124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:43.427100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:52:43.428114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:43.430778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 470/958] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:43.438165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:43.543826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba4f9-a0b5-4273-9877-41cd918b2e5d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:43.577955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25b0fa-e740-4d79-b3bc-aba5d8e4c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:43.578635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b0fa-e740-4d79-b3bc-aba5d8e4c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:43.578914 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b0fa-e740-4d79-b3bc-aba5d8e4c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:43.579182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b0fa-e740-4d79-b3bc-aba5d8e4c4e7 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:43.579992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25b0fa-e740-4d79-b3bc-aba5d8e4c4e7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:43.580292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25b0fa-e740-4d79-b3bc-aba5d8e4c4e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:43.581987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25b0fa-e740-4d79-b3bc-aba5d8e4c4e7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:43.621059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 489/959] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 11:52:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:43.868673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41259a-1beb-4af9-a189-beafd24e8618 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:43.868970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41259a-1beb-4af9-a189-beafd24e8618 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:43.869336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41259a-1beb-4af9-a189-beafd24e8618 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:43.870989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 471/960] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:43.876479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f8c00-0872-4186-84d2-18a48bef12ea None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:43.876809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f8c00-0872-4186-84d2-18a48bef12ea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:43.877082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f8c00-0872-4186-84d2-18a48bef12ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:43.895598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7e6f8c00-0872-4186-84d2-18a48bef12ea None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:43.897283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7e6f8c00-0872-4186-84d2-18a48bef12ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:43.919164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:43.974927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 490/961] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:43.997272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41259a-1beb-4af9-a189-beafd24e8618 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.106434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cecfe-61a5-4fdc-9a8f-7670a5f6784d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.106653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41259a-1beb-4af9-a189-beafd24e8618 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.106766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cecfe-61a5-4fdc-9a8f-7670a5f6784d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.107022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cecfe-61a5-4fdc-9a8f-7670a5f6784d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.108374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 491/962] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:44.114425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a0e2-939a-4c87-a952-aed72a3ec3fb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.114761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a0e2-939a-4c87-a952-aed72a3ec3fb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.115018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a0e2-939a-4c87-a952-aed72a3ec3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.132711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c586a0e2-939a-4c87-a952-aed72a3ec3fb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:44.133819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c586a0e2-939a-4c87-a952-aed72a3ec3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:44.155269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.156027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.156311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.156612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.157350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:44.158707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:44.171835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:44.184834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 472/963] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:43 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:44.220174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 492/964] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:44.244158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.284452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3515-3510-4df6-ae9a-98cea88801dc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.284817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3515-3510-4df6-ae9a-98cea88801dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.285124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3515-3510-4df6-ae9a-98cea88801dc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.287312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 493/965] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:44.292950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e267-6822-4f2e-93e8-78bbcc005432 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.293227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e267-6822-4f2e-93e8-78bbcc005432 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.293528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e267-6822-4f2e-93e8-78bbcc005432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.311372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8cf9e267-6822-4f2e-93e8-78bbcc005432 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:44.312597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8cf9e267-6822-4f2e-93e8-78bbcc005432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:44.364005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ebabd-0339-4398-8860-be6524aa13c6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.392312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 494/966] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:44.402832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.403490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.403770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.404038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.404764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:44.406126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:44.416001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e267-6822-4f2e-93e8-78bbcc005432 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:44.418655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:44.419663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:44.420591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 473/967] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:44.426435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:44.428273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.492942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:44.524399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e267-6822-4f2e-93e8-78bbcc005432 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.541041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5a6e-027a-4228-be3d-088606115b18 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.561750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.562587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.562838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.563123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.575360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:44.578826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.579537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.579815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.580081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.580860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:44.581161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:44.582620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:44.583687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:44.584748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:44.585590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 495/968] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 11:52:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:44.591052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 474/969] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:44.591182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.596518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.667444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:44.708037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad55022-ff15-4a48-a5a5-351418c1295e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.709227 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc1e2-bc1c-4baa-8ba6-3422cfc37d8e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.737201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:44.745254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.746148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.746345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.746734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.747001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.747275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.747441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.747542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.748223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:44.748521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:44.748734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:44.749184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:44.749917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:44.750840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:44.754916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 475/970] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:44.761488 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.761861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 496/971] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 11:52:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:44.767603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:44.871206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18c96-581b-483a-9351-b41ca43d0a4e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.880273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e2f9c-9b62-46e7-a515-8ec648fab8ff None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:44.906264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.906919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.907201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.907473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.908211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:44.909616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:44.911121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:44.919033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798903-58be-481d-a425-94e347193122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:44.919768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798903-58be-481d-a425-94e347193122 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:44.920056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798903-58be-481d-a425-94e347193122 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:44.920361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798903-58be-481d-a425-94e347193122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:44.929450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 476/972] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:52:44.940015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50798903-58be-481d-a425-94e347193122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:44.941637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50798903-58be-481d-a425-94e347193122 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-50798903-58be-481d-a425-94e347193122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:44.961369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:44.962390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:44.968470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:44.968470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:44.968470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:44.968470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:44.968470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 497/973] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:44.970700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:45.026542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:45.093254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335408d3-67e8-4761-9181-55cee68fd975 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:45.135412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:45.136080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:45.136353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:45.136619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:45.137366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:45.137670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:45.139036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:45.152460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 477/974] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:45.157819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798903-58be-481d-a425-94e347193122 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:45.263322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798903-58be-481d-a425-94e347193122 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:45.298795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:45.299612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:45.299888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:45.300155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:45.309434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:45.310960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:45.327191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:45.328207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:45.333422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 498/975] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:52:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:45.336055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:45.449050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9a33c-9ac6-4c21-ac72-f65f246327b8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:45.452215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:45.486499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:45.487162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:45.487434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:45.487700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:45.488571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:45.488928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:45.490388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:45.512562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 478/976] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 11:52:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:45.518250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:45.563526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:45.624061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8a24f-2f9d-4f85-a397-a47dc4e1cda7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:45.658497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:45.659129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:45.659406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:45.659673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:45.727064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:45.728533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:45.770040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:45.831605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 499/977] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:45 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:45.837373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:45.936255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3505-cced-4cb9-9461-e5b7fab2a85e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:45.969577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:45.970365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:45.970639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:45.970904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:45.981889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:45.983489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:46.001239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:46.002299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:46.007805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:46.007805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:46.007805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:46.007805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:46.007805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 479/978] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:46.009637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:46.121137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef088345-76f6-4525-b75d-414dc2af2287 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:46.155933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:46.156585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.156879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.157147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.157866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:46.158404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:46.159534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.173006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 500/979] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:46.177021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:46.194297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:46.290228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ed20a-a3a9-4179-aa5a-4d2e8f2b1edb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:46.324584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a0f4c-c9bd-413d-baf4-91533e27c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:46.325399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0f4c-c9bd-413d-baf4-91533e27c13b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.325678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0f4c-c9bd-413d-baf4-91533e27c13b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.325953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a0f4c-c9bd-413d-baf4-91533e27c13b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.332688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a0f4c-c9bd-413d-baf4-91533e27c13b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:46.334176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a0f4c-c9bd-413d-baf4-91533e27c13b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-265a0f4c-c9bd-413d-baf4-91533e27c13b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:46.347899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:46.352744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:46.353894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 480/980] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:46.356953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:46.359994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:46.392002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061d50c-ecc9-4b38-905d-414485907363 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.392200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061d50c-ecc9-4b38-905d-414485907363 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.392451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061d50c-ecc9-4b38-905d-414485907363 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.394006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 481/981] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:46.398937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b988a0-c92f-408e-954e-c2817e905295 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.399224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b988a0-c92f-408e-954e-c2817e905295 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.399499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b988a0-c92f-408e-954e-c2817e905295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.416778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-92b988a0-c92f-408e-954e-c2817e905295 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:46.418075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-92b988a0-c92f-408e-954e-c2817e905295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:46.468340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34d769-078a-4b47-a66f-0a1a855f9fe5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:46.486668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 482/982] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:46.511080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:46.512456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b988a0-c92f-408e-954e-c2817e905295 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:46.513004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.513288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.513609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.514717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:46.515076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:46.515517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:46.517587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.531413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 501/983] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:46.537099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:46.601595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:46.617526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b988a0-c92f-408e-954e-c2817e905295 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:46.645175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102e19b-59a3-4f7d-be9d-c9b9ff04ccbb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:46.651515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:46.652347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.652623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.652925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.653570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:46.654937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:46.667059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:46.668237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:46.669156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 483/984] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:46.674170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:46.684353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:46.685176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.685450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.685748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.686632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] RBAC: Adding query filter params (role.id=0d8ba816c5924e298c6b02aa4ed28600, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=b0ad031f63ba4d449df8f1f78116a890) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:46.686943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:46.688433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.700927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 502/985] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/role_assignments?user.id=b0ad031f63ba4d449df8f1f78116a890&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=0d8ba816c5924e298c6b02aa4ed28600 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:46.746478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:46.785207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e300-594f-4154-9bb9-0120aca319d9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:46.821783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:46.822452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.822728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.823022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.823707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:46.824010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:46.825437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.831151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 484/986] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:46.836861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:46.946306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6925f-dd96-49ce-8439-5b9df2871764 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:46.972913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:46.983937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:46.984623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:46.984936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:46.985186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:46.985932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:46.986237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:46.987669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:46.993981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 503/987] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:46.999738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:47.104028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bd095-8c2d-4ed6-8b57-3822490e1f37 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:47.133926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:47.140127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91a56a-2c78-423d-aa2f-3cc655707290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:47.140818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a56a-2c78-423d-aa2f-3cc655707290 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.141093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a56a-2c78-423d-aa2f-3cc655707290 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.141362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a56a-2c78-423d-aa2f-3cc655707290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.142151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a56a-2c78-423d-aa2f-3cc655707290 None admin] RBAC: Adding query filter params (interface=public, service_id=74fc053047694df18be6f4c8c76234d7, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:47.142454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a56a-2c78-423d-aa2f-3cc655707290 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:47.143823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a56a-2c78-423d-aa2f-3cc655707290 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:47.149771 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 485/988] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:52:46 2022] GET /identity/v3/endpoints?service_id=74fc053047694df18be6f4c8c76234d7&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:47.155083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:47.158484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ccab-1d80-4f07-92e4-bc7e44b153ed None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.158767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ccab-1d80-4f07-92e4-bc7e44b153ed None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.159025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4ccab-1d80-4f07-92e4-bc7e44b153ed None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.160357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 486/989] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:47.165954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd1a-2943-408b-a801-0f46c0320629 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.166258 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd1a-2943-408b-a801-0f46c0320629 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.166528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd1a-2943-408b-a801-0f46c0320629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.183604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0830dd1a-2943-408b-a801-0f46c0320629 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:47.184824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0830dd1a-2943-408b-a801-0f46c0320629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:47.260873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 487/990] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:47.267315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2cf4-0455-44f5-a182-17a10fa271ab None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:47.283075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd1a-2943-408b-a801-0f46c0320629 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:47.304076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:47.304841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.305542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.305827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.306510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:47.307959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:47.315266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 504/991] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:47 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:52:47.392694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd1a-2943-408b-a801-0f46c0320629 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:47.422541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:47.432827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:47.433639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.433926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.434195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.434854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:47.436244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:47.449555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:47.450668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:47.451515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:47.456291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 488/992] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:47.457455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:47.525907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:47.571183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d324f3-9987-4255-baf1-f67832ecedc3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:47.604997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:47.605657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.605940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.606212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.606916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:47.607217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:47.608596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:47.613423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 505/993] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:47.619292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:47.720537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a71d-55a6-4cd6-a6f8-b0d18afddc5a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:47.753773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:47.754433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.754712 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.754982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.755755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:47.756061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:47.757460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:47.762471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 489/994] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:47.768042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:47.875245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1740e1-32ed-49a0-9967-b7b934639a9e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:47.894533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:47.913657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e63d2-a900-48dd-9eb3-b076b1353502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:47.914659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e63d2-a900-48dd-9eb3-b076b1353502 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:47.915143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e63d2-a900-48dd-9eb3-b076b1353502 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:47.915616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e63d2-a900-48dd-9eb3-b076b1353502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:47.916659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e63d2-a900-48dd-9eb3-b076b1353502 None admin] RBAC: Adding query filter params (interface=admin, service_id=d503a2bdf37547b8b94e0c830807fd7d, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:47.917195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e63d2-a900-48dd-9eb3-b076b1353502 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:47.918964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e63d2-a900-48dd-9eb3-b076b1353502 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:47.924933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 506/995] 10.222.0.35 () {56 vars in 1249 bytes} [Thu May 19 11:52:47 2022] GET /identity/v3/endpoints?service_id=d503a2bdf37547b8b94e0c830807fd7d&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:47.930122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:47.987791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:48.036757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dff2b-a455-4978-a934-a1c264cc33ee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:48.071019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c8e14-ab78-4b71-a732-fd1748c6fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:48.071684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c8e14-ab78-4b71-a732-fd1748c6fa40 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:48.071965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c8e14-ab78-4b71-a732-fd1748c6fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:48.072237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c8e14-ab78-4b71-a732-fd1748c6fa40 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:48.072956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c8e14-ab78-4b71-a732-fd1748c6fa40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:48.074317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c8e14-ab78-4b71-a732-fd1748c6fa40 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:48.088966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 490/996] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:47 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 11:52:48.937349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825cd29-a7e6-418a-bc12-3218bcd6dfbd None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:48.937894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825cd29-a7e6-418a-bc12-3218bcd6dfbd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:48.937894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825cd29-a7e6-418a-bc12-3218bcd6dfbd None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:48.939590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 507/997] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:48.944622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d346f-0404-457d-8b2b-e4d07faee593 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:48.945074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d346f-0404-457d-8b2b-e4d07faee593 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:48.945216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d346f-0404-457d-8b2b-e4d07faee593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:48.963867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8a1d346f-0404-457d-8b2b-e4d07faee593 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:48.965201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8a1d346f-0404-457d-8b2b-e4d07faee593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:49.037267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 491/998] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:49.059660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825cd29-a7e6-418a-bc12-3218bcd6dfbd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:49.178023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825cd29-a7e6-418a-bc12-3218bcd6dfbd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:49.215853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:49.216566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:49.216930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:49.217106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:49.217769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:49.219140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:49.230969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:49.231984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:49.237814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 508/999] 10.222.0.35 () {56 vars in 1105 bytes} [Thu May 19 11:52:49 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:49.240475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d346f-0404-457d-8b2b-e4d07faee593 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:49.291070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:49.342905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d346f-0404-457d-8b2b-e4d07faee593 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:49.380911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdcbd5-22bc-4c8a-a87e-e37598a237ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:49.381593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdcbd5-22bc-4c8a-a87e-e37598a237ba None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:49.381871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdcbd5-22bc-4c8a-a87e-e37598a237ba None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:49.382141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdcbd5-22bc-4c8a-a87e-e37598a237ba None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:49.382857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdcbd5-22bc-4c8a-a87e-e37598a237ba None admin] RBAC: Adding query filter params (name=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:49.383146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdcbd5-22bc-4c8a-a87e-e37598a237ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:49.384580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdcbd5-22bc-4c8a-a87e-e37598a237ba None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:49.390558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 492/1000] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:49.396132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:49.443305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:49.505189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6a99-d27e-4124-bd23-ef7b3fd6d783 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:49.541378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a1a2e-83ac-4895-b381-f13b2550f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:49.542047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1a2e-83ac-4895-b381-f13b2550f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:49.542327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1a2e-83ac-4895-b381-f13b2550f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:49.542599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a1a2e-83ac-4895-b381-f13b2550f9e9 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:49.543308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a1a2e-83ac-4895-b381-f13b2550f9e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:49.543613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a1a2e-83ac-4895-b381-f13b2550f9e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:49.545030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a1a2e-83ac-4895-b381-f13b2550f9e9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:49.557135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 509/1001] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:49.558597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49519-179b-400c-8dd2-115724c81a12 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:49.558868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49519-179b-400c-8dd2-115724c81a12 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:49.559136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49519-179b-400c-8dd2-115724c81a12 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:49.560570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 493/1002] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:49.566871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5bcbe-7afa-4ca1-bca0-c6ad9ce0145a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:49.567155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5bcbe-7afa-4ca1-bca0-c6ad9ce0145a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:49.567427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5bcbe-7afa-4ca1-bca0-c6ad9ce0145a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:49.586139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-02f5bcbe-7afa-4ca1-bca0-c6ad9ce0145a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:49.587380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02f5bcbe-7afa-4ca1-bca0-c6ad9ce0145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:49.668208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 510/1003] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:49.690775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49519-179b-400c-8dd2-115724c81a12 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:49.800462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49519-179b-400c-8dd2-115724c81a12 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:49.814042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:49.835837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:49.836747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:49.837088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:49.837419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:49.838131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:49.839623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:49.851452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:49.852869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:52:49.853894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:49.859769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 494/1004] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:49.861372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5bcbe-7afa-4ca1-bca0-c6ad9ce0145a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:49.905920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:49.966296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5bcbe-7afa-4ca1-bca0-c6ad9ce0145a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:50.000504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:50.001188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.001462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.001726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.002432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] RBAC: Adding query filter params (name=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:50.002732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:50.004111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:50.009331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 511/1005] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:50.014907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:50.122136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea140f6-a6ae-4e70-881d-440d95848641 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:50.157715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee5d3e-cf1a-46f4-a306-bc1c7933816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:50.158376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5d3e-cf1a-46f4-a306-bc1c7933816e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.158655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5d3e-cf1a-46f4-a306-bc1c7933816e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.158920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee5d3e-cf1a-46f4-a306-bc1c7933816e None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.159625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee5d3e-cf1a-46f4-a306-bc1c7933816e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:50.159924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee5d3e-cf1a-46f4-a306-bc1c7933816e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:50.161328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee5d3e-cf1a-46f4-a306-bc1c7933816e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:50.166943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 495/1006] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 11:52:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:50.172332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:50.272825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27638b-0eeb-49e6-b967-39e879bd69da None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:50.275163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:50.288372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250e170-50fd-4d65-997c-0b71ad6d65dc None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.289095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250e170-50fd-4d65-997c-0b71ad6d65dc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.289379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250e170-50fd-4d65-997c-0b71ad6d65dc None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.290768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 496/1007] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:50.296322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de8434-36fb-4035-a9e5-13a83fde4ca8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.296612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de8434-36fb-4035-a9e5-13a83fde4ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.296937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de8434-36fb-4035-a9e5-13a83fde4ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.312659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:50.313315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.313591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.313862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.314257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-07de8434-36fb-4035-a9e5-13a83fde4ca8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:50.314604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:50.315458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-07de8434-36fb-4035-a9e5-13a83fde4ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:50.315981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:50.344860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 512/1008] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:50.355486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:50.404096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 497/1009] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:50 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:50.427531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:50.548392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2cd42-ac01-4ec6-8688-5871630c4601 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:50.580707 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:50.581526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.581873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.582146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.582799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:50.584274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:50.597151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:50.598256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:50.599745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 513/1010] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 11:52:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:50.604454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de8434-36fb-4035-a9e5-13a83fde4ca8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:50.711156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de8434-36fb-4035-a9e5-13a83fde4ca8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:50.745194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:50.746012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.746387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.746779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.747589 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:50.747990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:50.749492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:50.754803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 498/1011] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:50.760620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:50.787122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:50.863119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae61f72-ebb3-45cd-9f2b-5c5c6f3c1cc0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:50.896788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82b051-1d83-443c-8014-ba91ead3865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:50.897607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b051-1d83-443c-8014-ba91ead3865c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:50.897985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b051-1d83-443c-8014-ba91ead3865c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:50.898351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b051-1d83-443c-8014-ba91ead3865c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:50.899153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82b051-1d83-443c-8014-ba91ead3865c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:50.899552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82b051-1d83-443c-8014-ba91ead3865c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:50.901060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82b051-1d83-443c-8014-ba91ead3865c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:50.906250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 514/1012] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 11:52:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:50.911968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:50.942264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:51.015461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf33c7-a539-4a62-b1e5-9d6a4b2b29f3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:51.049253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3e581-359c-4c9f-a774-e5f5d3b45d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:51.049900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3e581-359c-4c9f-a774-e5f5d3b45d6f None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:51.050181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3e581-359c-4c9f-a774-e5f5d3b45d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:51.050452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3e581-359c-4c9f-a774-e5f5d3b45d6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:51.051193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3e581-359c-4c9f-a774-e5f5d3b45d6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:51.052585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3e581-359c-4c9f-a774-e5f5d3b45d6f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:51.072840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 499/1013] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:51.772985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47408b-3d09-4336-baac-ac510ac893e3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:51.773482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47408b-3d09-4336-baac-ac510ac893e3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:51.773482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47408b-3d09-4336-baac-ac510ac893e3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:51.775021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 515/1014] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:51.780328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff1049-b713-4f40-b1e1-641fe78c5820 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:51.780586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff1049-b713-4f40-b1e1-641fe78c5820 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:51.780920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff1049-b713-4f40-b1e1-641fe78c5820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:51.798728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c0ff1049-b713-4f40-b1e1-641fe78c5820 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:51.799895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c0ff1049-b713-4f40-b1e1-641fe78c5820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:51.885534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 500/1015] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:51 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:51.907500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47408b-3d09-4336-baac-ac510ac893e3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:51.996405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:52.010875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47408b-3d09-4336-baac-ac510ac893e3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:52.045265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555363-929e-4bc8-ab13-e935a4446d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:52.045847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555363-929e-4bc8-ab13-e935a4446d79 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:52.046120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555363-929e-4bc8-ab13-e935a4446d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:52.046385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555363-929e-4bc8-ab13-e935a4446d79 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:52.047109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555363-929e-4bc8-ab13-e935a4446d79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:52.048481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555363-929e-4bc8-ab13-e935a4446d79 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:52.068678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 516/1016] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:51 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:52.684276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6930-e87f-41cf-b3be-7c2451619b7b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:52.684825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6930-e87f-41cf-b3be-7c2451619b7b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:52.684903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6930-e87f-41cf-b3be-7c2451619b7b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:52.686271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 501/1017] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:52.691636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6558-7411-4e0b-8217-26cf0dae5559 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:52.691923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6558-7411-4e0b-8217-26cf0dae5559 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:52.692239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6558-7411-4e0b-8217-26cf0dae5559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:52.709734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-872d6558-7411-4e0b-8217-26cf0dae5559 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:52.710913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-872d6558-7411-4e0b-8217-26cf0dae5559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:52.787123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 517/1018] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:52.810727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b6930-e87f-41cf-b3be-7c2451619b7b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:52.829177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:52.925321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b6930-e87f-41cf-b3be-7c2451619b7b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:52.961323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:52.962391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:52.962821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:52.963247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:52.973739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:52.982285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:52.983375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:52.984251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:52.988793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 502/1019] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 11:52:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:52.990304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6558-7411-4e0b-8217-26cf0dae5559 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.066421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:53.095880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6558-7411-4e0b-8217-26cf0dae5559 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:53.137362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1d057-8699-4419-bb6b-877e68243f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:53.138032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1d057-8699-4419-bb6b-877e68243f0f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.138282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1d057-8699-4419-bb6b-877e68243f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.138581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1d057-8699-4419-bb6b-877e68243f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.139334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1d057-8699-4419-bb6b-877e68243f0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:53.139638 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1d057-8699-4419-bb6b-877e68243f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:53.141051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1d057-8699-4419-bb6b-877e68243f0f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:53.155050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 518/1020] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 11:52:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:53.156479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.244753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:53.270822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd07d-4194-4dd7-a5f5-17a122c58b19 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:53.274345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed108e-601e-440b-a8d8-00c43fd939f6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.274629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed108e-601e-440b-a8d8-00c43fd939f6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.274906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed108e-601e-440b-a8d8-00c43fd939f6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.276423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 519/1021] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:53.281563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa787b4-dbb4-4dbb-8f7f-6610a4e6e490 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.281847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa787b4-dbb4-4dbb-8f7f-6610a4e6e490 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.282117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa787b4-dbb4-4dbb-8f7f-6610a4e6e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.299787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1fa787b4-dbb4-4dbb-8f7f-6610a4e6e490 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:53.301003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1fa787b4-dbb4-4dbb-8f7f-6610a4e6e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:53.311726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:53.312533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.312849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.313124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.324836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:53.326678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:53.344125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:53.345120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:53.346024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:53.346024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:53.346024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:53.346024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:53.346024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 503/1022] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:53.350906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.372697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 520/1023] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:53.395150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa787b4-dbb4-4dbb-8f7f-6610a4e6e490 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.456229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03daa2e-151b-491e-a2d0-a78223fd099d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:53.464620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:53.485205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:53.494507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:53.495234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.495580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.495940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.496667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:53.496994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:53.498368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:53.507614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa787b4-dbb4-4dbb-8f7f-6610a4e6e490 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:53.517887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 504/1024] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:53.518909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.548866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:53.549818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.550374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.550889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.552124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:53.554469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:53.556360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 521/1025] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:53.561804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.620890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e4fd-b42b-4e82-8a36-bc5adeb8d5bc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:53.655044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:53.655951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.656237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.656515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.664243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:53.665706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:53.668600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4fb56-f0d5-487c-b43b-9f0dfeb926e3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:53.680290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:53.681366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:53.682347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:53.686397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 505/1026] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:52:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:53.687125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.705181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:53.705842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.706124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.706387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.707087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:53.708592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:53.712338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:53.748668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 522/1027] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:52:53 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:53.754096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:53.814619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce737f-a1fc-44c1-8a95-d6c98ef74e38 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:53.852127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:53.852830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:53.853107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:53.853379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:53.854224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:53.854530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:53.855982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:53.875605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 506/1028] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:52:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:53.881492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:53.989699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c105-2168-44be-9588-39d3919ff717 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.024205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fbe77-487a-4a4b-8524-8e4363061bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.024893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fbe77-487a-4a4b-8524-8e4363061bbb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.025175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fbe77-487a-4a4b-8524-8e4363061bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.025448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fbe77-487a-4a4b-8524-8e4363061bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.081027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:54.100917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fbe77-487a-4a4b-8524-8e4363061bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.102410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fbe77-487a-4a4b-8524-8e4363061bbb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.218831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 523/1029] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:52:54.220014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.277729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180847ce-0b9d-4dc0-93c4-583a37c3fb10 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.278006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180847ce-0b9d-4dc0-93c4-583a37c3fb10 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.278279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180847ce-0b9d-4dc0-93c4-583a37c3fb10 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.279654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 524/1030] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:54.284664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4db72-dac5-4a94-bcc6-eeef101b15f3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.284952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4db72-dac5-4a94-bcc6-eeef101b15f3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.285223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4db72-dac5-4a94-bcc6-eeef101b15f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.305193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-49f4db72-dac5-4a94-bcc6-eeef101b15f3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:54.306394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-49f4db72-dac5-4a94-bcc6-eeef101b15f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:54.327668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831527c-d1b7-447b-b736-8c78b97b20f2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.335319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:54.364243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.365112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.365388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.365658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.376222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.377888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.384746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 525/1031] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:54.396204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:54.397237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:54.398298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:54.398298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:54.398298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:54.398298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:54.404296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 507/1032] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:54.405437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4db72-dac5-4a94-bcc6-eeef101b15f3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.407362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.426225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:54.516913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644228f4-15d4-4c46-8527-3103efbe878c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.519045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4db72-dac5-4a94-bcc6-eeef101b15f3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.553253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.554321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.554819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.555146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.555407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] PATH_INFO: `/v3/services/image` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.555805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.556082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.556350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.556839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.557142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:54.557443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.558724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.558888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:54.571722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:54.572914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:54.577528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 508/1033] 10.222.0.35 () {56 vars in 1105 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:54.579852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.581454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 526/1034] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:54.586915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.605368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:54.672288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:54.683723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa312-5eba-431a-bc56-fc65a21d465c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.699898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8e0bb-98a8-4b89-b4c9-01ef52495e15 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.718968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.719635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.719909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.720178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.720911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] RBAC: Adding query filter params (name=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:54.721211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.722586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.732899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 509/1035] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:54.734282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.739599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.740399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.740719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.740988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.749051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.750502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:54.766557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:54.767469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:54.768479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:54.772563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 527/1036] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:54.773486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.830070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:54.843566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288af62-d4db-4eb6-b7c0-bdf2c96ee12f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.878098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec40e96-3a01-48a0-9399-8e86b98b5d2f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:54.887991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.888949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.889431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.889940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.890849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] RBAC: Adding query filter params (type=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:54.891308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.893088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.904498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 510/1037] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:54.905736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:54.922069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:54.922728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:54.923005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:54.923274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:54.924049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:54.924359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:54.925829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:54.928754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:54.940066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 528/1038] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:54.945735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:55.012828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffbc1e-1e0b-40c7-b9d3-e65721623dec None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:55.047753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:55.048322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:55.048601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:55.048903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:55.049694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] RBAC: Adding query filter params (interface=public, service_id=7710425893e3458da7bf86932b96ce45, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:55.050013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:55.051383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:55.057126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 511/1039] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/endpoints?service_id=7710425893e3458da7bf86932b96ce45&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:55.058739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6ee73-ef75-4410-8b1d-57b58ef878c0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:55.062459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:55.080231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:55.099448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c4b87-3548-4c2d-af93-96ae9a825204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:55.100325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c4b87-3548-4c2d-af93-96ae9a825204 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:55.100627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c4b87-3548-4c2d-af93-96ae9a825204 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:55.100932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c4b87-3548-4c2d-af93-96ae9a825204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:55.102562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c4b87-3548-4c2d-af93-96ae9a825204 None admin] RBAC: Adding query filter params (role.id=0d8ba816c5924e298c6b02aa4ed28600, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=7d4f967c85db412aacf6c8b441dbdeb1) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:55.102879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c4b87-3548-4c2d-af93-96ae9a825204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:55.104348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c4b87-3548-4c2d-af93-96ae9a825204 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:55.112794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 529/1040] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:54 2022] GET /identity/v3/role_assignments?user.id=7d4f967c85db412aacf6c8b441dbdeb1&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=0d8ba816c5924e298c6b02aa4ed28600 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:55.184798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fca55e-7fa2-4fd5-b34e-b6a293214f41 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:55.221688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137849d-e797-4e55-abd0-b1e6c725ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:55.222358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137849d-e797-4e55-abd0-b1e6c725ea00 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:55.222634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137849d-e797-4e55-abd0-b1e6c725ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:55.222909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137849d-e797-4e55-abd0-b1e6c725ea00 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:55.223592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137849d-e797-4e55-abd0-b1e6c725ea00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:55.225068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137849d-e797-4e55-abd0-b1e6c725ea00 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:55.240972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 512/1041] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:52:55 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:52:55.994265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfb89a-d515-4b93-9809-d73997a043d9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:55.994919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfb89a-d515-4b93-9809-d73997a043d9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:55.994919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfb89a-d515-4b93-9809-d73997a043d9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:55.996320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 530/1042] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:56.001485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f104a-3478-4472-b5a8-587c7210202c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:56.001913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f104a-3478-4472-b5a8-587c7210202c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:56.002002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f104a-3478-4472-b5a8-587c7210202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:56.018742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b83f104a-3478-4472-b5a8-587c7210202c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:56.019911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b83f104a-3478-4472-b5a8-587c7210202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:56.086454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 513/1043] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:56.110113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfb89a-d515-4b93-9809-d73997a043d9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:56.173782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:56.218908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfb89a-d515-4b93-9809-d73997a043d9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:56.254662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ea5f-2965-49be-a53d-4f83d6e5ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:56.255511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ea5f-2965-49be-a53d-4f83d6e5ae5f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:56.255726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ea5f-2965-49be-a53d-4f83d6e5ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:56.255950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ea5f-2965-49be-a53d-4f83d6e5ae5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:56.257149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ea5f-2965-49be-a53d-4f83d6e5ae5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:56.258577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ea5f-2965-49be-a53d-4f83d6e5ae5f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:56.260389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 531/1044] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:56.265860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f104a-3478-4472-b5a8-587c7210202c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:56.276215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:56.374408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f104a-3478-4472-b5a8-587c7210202c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:56.410042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6fa0-3d05-4f9b-9db1-e2bb984a8112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:56.410709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6fa0-3d05-4f9b-9db1-e2bb984a8112 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:56.410986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6fa0-3d05-4f9b-9db1-e2bb984a8112 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:56.411285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6fa0-3d05-4f9b-9db1-e2bb984a8112 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:56.412002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6fa0-3d05-4f9b-9db1-e2bb984a8112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:56.413790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6fa0-3d05-4f9b-9db1-e2bb984a8112 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:56.436129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 514/1045] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:52:56 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:52:57.312789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd8d62-a459-4785-bb77-f0377f775cde None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.313375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd8d62-a459-4785-bb77-f0377f775cde None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.313375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd8d62-a459-4785-bb77-f0377f775cde None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.314662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 532/1046] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:52:57.320205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61677147-d39a-4712-9e84-1cca1acbb267 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.320697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61677147-d39a-4712-9e84-1cca1acbb267 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.320776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61677147-d39a-4712-9e84-1cca1acbb267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.338104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-61677147-d39a-4712-9e84-1cca1acbb267 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:57.339283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-61677147-d39a-4712-9e84-1cca1acbb267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:57.402524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:57.416783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 515/1047] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:52:57.435190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd8d62-a459-4785-bb77-f0377f775cde None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:57.448140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be847f1e-1c8a-4608-815f-52a17e96a8d8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.448436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be847f1e-1c8a-4608-815f-52a17e96a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.448735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be847f1e-1c8a-4608-815f-52a17e96a8d8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.450394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 516/1048] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:57.455097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a711-0259-40dd-a5df-e76e1d2c9513 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.455384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a711-0259-40dd-a5df-e76e1d2c9513 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.455689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a711-0259-40dd-a5df-e76e1d2c9513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.472951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a6c2a711-0259-40dd-a5df-e76e1d2c9513 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:57.474184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a6c2a711-0259-40dd-a5df-e76e1d2c9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:57.548829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd8d62-a459-4785-bb77-f0377f775cde None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:57.555668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 517/1049] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:57.571630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a711-0259-40dd-a5df-e76e1d2c9513 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:57.578002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:57.588132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:57.589001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.589284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.589553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.600886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:57.609386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:57.610602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:57.611451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 533/1050] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 11:52:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:57.616896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:57.683973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a711-0259-40dd-a5df-e76e1d2c9513 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:57.709201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:57.721744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:57.722530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.722805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.723069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] PATH_INFO: `/v3/services/image` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.723767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:57.724188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8c557-b7d2-428e-b8f5-483596d21fe1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:57.725177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:57.738938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:57.739978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:57.740878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 518/1051] 10.222.0.35 () {56 vars in 1105 bytes} [Thu May 19 11:52:57 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:57.746167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:57.762437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:57.763102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.763379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.763649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.764396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:57.764738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:57.766114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:57.774379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 534/1052] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 11:52:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:57.779940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:57.833319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:57.855722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74a7b6-32b0-42da-9baf-982d09df3e71 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:57.887537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbe23c-96e4-442c-8ada-e10ead182f5e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:57.890281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:57.891015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.891358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.891641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.892340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] RBAC: Adding query filter params (name=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:57.892657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:57.894030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:57.904194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 519/1053] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:57.904956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:57.922546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:57.923339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:57.923614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:57.923881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:57.934538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:57.935983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:57.953108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:57.954127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:57.955146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:57.955146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:57.955146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:57.955146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:57.958976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 535/1054] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:57.959775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:57.965685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:58.015942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a8373-c691-472d-802c-98d623a2fd84 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.051320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.052082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.052358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.052629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.053353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:58.054058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:58.055810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:58.061868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 520/1055] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:58.066956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8b373-03c6-4064-b6a1-3786027578e1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.067382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:58.068979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:58.106352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.107117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.107227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.107465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.108183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:58.108485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:58.109899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:58.122028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 536/1056] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:58.127316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:58.171126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4292591-3b82-4141-a42e-9572b8b0fcf4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.188351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:58.208538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.209427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.209804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.210236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.211043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:58.212422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:58.232685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 521/1057] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:52:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:52:58.237769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cb35d-b5a6-45f7-a231-2bc52eb13c07 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.284426 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.285261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.285542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.285810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.295514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:58.297111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:52:58.313587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:58.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:58.321170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 537/1058] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:52:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:58.323359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:58.437513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3aaa2-68e5-43a5-9497-9aa945e3b611 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.472304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.473028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.473311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.473636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.474474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:58.474778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:58.476211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:58.494077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 522/1059] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:52:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:58.500313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:58.524009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:58.611538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c8ef-d474-480d-870b-9a45e32b9374 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.645544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190709a-c5cb-4e62-af0a-a36908f0db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.646329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190709a-c5cb-4e62-af0a-a36908f0db9d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.646602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190709a-c5cb-4e62-af0a-a36908f0db9d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.646867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190709a-c5cb-4e62-af0a-a36908f0db9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.657725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190709a-c5cb-4e62-af0a-a36908f0db9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:58.659180 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190709a-c5cb-4e62-af0a-a36908f0db9d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d190709a-c5cb-4e62-af0a-a36908f0db9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:52:58.676751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:58.677691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:58.678589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:52:58.678589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:52:58.678589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:52:58.678589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:58.680724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 538/1060] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:52:58.683649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:58.692318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a2a00-9964-4fbf-937a-f57fe1f27603 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.692454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a2a00-9964-4fbf-937a-f57fe1f27603 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.693243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a2a00-9964-4fbf-937a-f57fe1f27603 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.695343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 539/1061] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:52:58.699882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39935-f518-4318-902d-551f372b98f3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.700151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39935-f518-4318-902d-551f372b98f3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.700837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39935-f518-4318-902d-551f372b98f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.717909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:58.718359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-45d39935-f518-4318-902d-551f372b98f3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:52:58.719614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45d39935-f518-4318-902d-551f372b98f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:52:58.785447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:58.792119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 540/1062] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:52:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:52:58.805582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc6a4-bf2a-415a-b39e-171b69f9ae2e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.814551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d39935-f518-4318-902d-551f372b98f3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:58.839511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.840134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.840410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.840716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.841441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:58.841745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:58.843109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:58.854352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 523/1063] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:58.859778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:58.934218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d39935-f518-4318-902d-551f372b98f3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.962429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:58.970441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:58.971248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:58.971508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:58.971772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:58.974243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25c994-ce95-4c95-b7cc-3ed04c6388ed None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:58.982189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:52:58.989854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:58.990796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:52:58.992458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 541/1064] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:58.996982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:59.013855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.014650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.014932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.015207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.022306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.023724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:52:59.038685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:52:59.039628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:52:59.040524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 524/1065] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:52:59.045635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:59.061251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:59.107494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fbcd9-41c6-4cea-adf7-edb3f3dab485 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:59.142100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.142869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.143144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.143411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.144147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:59.144441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.145871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.150477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429826a9-d6de-4aba-a13b-05a7be447da6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:59.154079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 542/1066] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:59.161268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:59.189666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.190321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.190599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.191003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.191718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:59.192019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.193617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.213453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 525/1067] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:52:59.214999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:59.227473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:59.281244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9a64-f04a-455b-adff-b947b74451e2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:59.309728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:59.317270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984d4f8-bae8-45ae-ad83-3c0f3c3dea5a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:59.322755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.323624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.323898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.324168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] PATH_INFO: `/v3/users/ae8f39a899a24790be974107352d7a6c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.338811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] RBAC: Authorizing `identity:get_user(user_id=ae8f39a899a24790be974107352d7a6c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.340614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.342547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 543/1068] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:52:59 2022] GET /identity/v3/users/ae8f39a899a24790be974107352d7a6c => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:59.347884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:59.351836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.353290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.353567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.353836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/7d4f967c85db412aacf6c8b441dbdeb1/roles/0d8ba816c5924e298c6b02aa4ed28600` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.356110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=7d4f967c85db412aacf6c8b441dbdeb1, role_id=0d8ba816c5924e298c6b02aa4ed28600)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.357620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.375123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 526/1069] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:52:59 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/7d4f967c85db412aacf6c8b441dbdeb1/roles/0d8ba816c5924e298c6b02aa4ed28600 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:52:59.464813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ebdf7-c393-488c-b4fc-423983227f13 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:59.509968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.510647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.510930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.511205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.566876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:59.587699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.589182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.692701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 544/1070] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:52:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:52:59.695713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:59.767057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:59.802622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc703478-c87d-4fde-8d66-4692b51f2c66 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:59.835949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63eade-36c5-4d9d-afa0-e112fc53f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.836843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63eade-36c5-4d9d-afa0-e112fc53f249 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.837113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63eade-36c5-4d9d-afa0-e112fc53f249 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.837374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63eade-36c5-4d9d-afa0-e112fc53f249 None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.838546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63eade-36c5-4d9d-afa0-e112fc53f249 None admin] RBAC: Authorizing `identity:get_project(project_id=e320519e7fa343bd8b5a8a76c7e69801)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.839975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63eade-36c5-4d9d-afa0-e112fc53f249 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.846579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 527/1071] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:52:59 2022] GET /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:52:59.848120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:52:59.932357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:52:59.953112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582446-4da8-4bca-ba8a-ecde801ebdca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:52:59.987861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff2e1f-f2a5-40ab-99db-8d0d62f0b6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:52:59.988510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2e1f-f2a5-40ab-99db-8d0d62f0b6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:52:59.988823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2e1f-f2a5-40ab-99db-8d0d62f0b6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:52:59.989234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2e1f-f2a5-40ab-99db-8d0d62f0b6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:52:59.990062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff2e1f-f2a5-40ab-99db-8d0d62f0b6b8 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=e320519e7fa343bd8b5a8a76c7e69801, user.id=ae8f39a899a24790be974107352d7a6c) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:52:59.990366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff2e1f-f2a5-40ab-99db-8d0d62f0b6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:52:59.991788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff2e1f-f2a5-40ab-99db-8d0d62f0b6b8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:52:59.997787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 545/1072] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:52:59 2022] GET /identity/v3/role_assignments?user.id=ae8f39a899a24790be974107352d7a6c&scope.project.id=e320519e7fa343bd8b5a8a76c7e69801&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:00.492887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6667-86a4-454b-bb08-848456a1af61 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:00.493437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6667-86a4-454b-bb08-848456a1af61 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:00.493437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6667-86a4-454b-bb08-848456a1af61 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:00.495011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 528/1073] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:00.502885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194803-9c18-4c06-8219-23c07ebb809c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:00.502885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194803-9c18-4c06-8219-23c07ebb809c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:00.502885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194803-9c18-4c06-8219-23c07ebb809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:00.520623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b3194803-9c18-4c06-8219-23c07ebb809c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:00.521811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b3194803-9c18-4c06-8219-23c07ebb809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:00.591363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 546/1074] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:00.613344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6667-86a4-454b-bb08-848456a1af61 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:00.716877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6667-86a4-454b-bb08-848456a1af61 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:00.755500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:00.756048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:00.756328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:00.756594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:00.765462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:00.825232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:00.826666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:00.923557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 529/1075] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:00.929453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3194803-9c18-4c06-8219-23c07ebb809c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:01.007813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:01.033647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3194803-9c18-4c06-8219-23c07ebb809c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:01.067500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4234bb-be0e-486f-90b7-b4d37e3fee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:01.068290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4234bb-be0e-486f-90b7-b4d37e3fee09 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:01.068564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4234bb-be0e-486f-90b7-b4d37e3fee09 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:01.068859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4234bb-be0e-486f-90b7-b4d37e3fee09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:01.078963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4234bb-be0e-486f-90b7-b4d37e3fee09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:01.080406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4234bb-be0e-486f-90b7-b4d37e3fee09 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ea4234bb-be0e-486f-90b7-b4d37e3fee09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:53:01.098625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:01.099692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:01.100732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:53:01.100732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:53:01.100732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:53:01.100732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:01.104867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 547/1076] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:01.106151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:01.147355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:01.209552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5e2e-9802-4e77-ad4b-64c72fdfd805 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:01.249030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456cc16-f5f0-43a4-8f21-2aaffb0f0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:01.249693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456cc16-f5f0-43a4-8f21-2aaffb0f0c8b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:01.249943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456cc16-f5f0-43a4-8f21-2aaffb0f0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:01.250236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456cc16-f5f0-43a4-8f21-2aaffb0f0c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:01.250952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456cc16-f5f0-43a4-8f21-2aaffb0f0c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:01.251252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456cc16-f5f0-43a4-8f21-2aaffb0f0c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:01.252614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456cc16-f5f0-43a4-8f21-2aaffb0f0c8b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:01.265290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 530/1077] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:01.604046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30c2aa-d3aa-4892-8cad-c027dbb81815 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:01.604621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30c2aa-d3aa-4892-8cad-c027dbb81815 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:01.604621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30c2aa-d3aa-4892-8cad-c027dbb81815 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:01.605968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 548/1078] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:01.611326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36620f86-1ba6-40da-bc93-8d33e8772701 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:01.611762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36620f86-1ba6-40da-bc93-8d33e8772701 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:01.611869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36620f86-1ba6-40da-bc93-8d33e8772701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:01.629015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-36620f86-1ba6-40da-bc93-8d33e8772701 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:01.630226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36620f86-1ba6-40da-bc93-8d33e8772701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:01.698603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 531/1079] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:01.722039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30c2aa-d3aa-4892-8cad-c027dbb81815 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:01.830175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30c2aa-d3aa-4892-8cad-c027dbb81815 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:01.856936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:01.866578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:01.867392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:01.867673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:01.867943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:01.878636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:01.886747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:01.887700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:01.888550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 549/1080] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 11:53:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:01.894035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36620f86-1ba6-40da-bc93-8d33e8772701 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:01.922627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:01.999254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36620f86-1ba6-40da-bc93-8d33e8772701 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.041032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d4ed6-43d8-4cf1-964f-60422a98a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.041695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d4ed6-43d8-4cf1-964f-60422a98a46f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.041973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d4ed6-43d8-4cf1-964f-60422a98a46f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.042242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d4ed6-43d8-4cf1-964f-60422a98a46f None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.042994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d4ed6-43d8-4cf1-964f-60422a98a46f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:02.043298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d4ed6-43d8-4cf1-964f-60422a98a46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.044674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d4ed6-43d8-4cf1-964f-60422a98a46f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.053467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 532/1081] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 11:53:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:02.059331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.164742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7657e0-7c97-4ccd-9f3d-92f1ee226c0c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.199185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b3a55-cf32-468e-8d8e-1b1fefa3768d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.199472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b3a55-cf32-468e-8d8e-1b1fefa3768d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.199578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.199750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b3a55-cf32-468e-8d8e-1b1fefa3768d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.200279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.200553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.200845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.201158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 533/1082] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:53:02.207312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347dd6c-320a-4005-80ad-a059ee6b3b7e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.207598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347dd6c-320a-4005-80ad-a059ee6b3b7e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.207870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347dd6c-320a-4005-80ad-a059ee6b3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.214952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.216517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.226023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e347dd6c-320a-4005-80ad-a059ee6b3b7e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:02.227219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e347dd6c-320a-4005-80ad-a059ee6b3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:53:02.233943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:02.234991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:02.235903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:53:02.235903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:53:02.235903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:53:02.235903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:02.235903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 550/1083] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:02.240753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.280098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:02.293762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 534/1084] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:02.316056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347dd6c-320a-4005-80ad-a059ee6b3b7e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.337481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:02.340171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46eb7-655f-4d29-b35e-f2a8add9416f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.373265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.373918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.374206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.374484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.375210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:02.375524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.376950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.389906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 551/1085] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:02.395611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.416945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347dd6c-320a-4005-80ad-a059ee6b3b7e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.451356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.452144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.452418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.452710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.462631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:02.470142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:02.471299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:02.472357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 535/1086] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:53:02.477285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.493445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:02.498703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff25f57-3341-42bd-a597-b3722a96b4fb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.534558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.535349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.535642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.535896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.543653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.545148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:53:02.558986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:02.560078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:53:02.561079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:02.562325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:02.562511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 552/1087] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:02.566009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.580506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c2d1e-768d-4c31-97c4-8a6951983d56 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.613682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.614395 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.614676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.614945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.615680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:02.615980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.617378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.625364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 536/1088] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:02.632751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.669873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231b137-9909-4379-a507-6af7c9c69ff7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.702927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.703598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.703872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.704138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.705015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:02.705324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.706760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.723697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 553/1089] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:02.729385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.733152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ad895-bed0-426e-9b7c-d948b84cf70f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.746960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:02.766097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.766979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.767259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.767531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] PATH_INFO: `/v3/users/ae8f39a899a24790be974107352d7a6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.768738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] RBAC: Authorizing `identity:get_user(user_id=ae8f39a899a24790be974107352d7a6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.770205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.771861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 537/1090] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/users/ae8f39a899a24790be974107352d7a6c => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:02.777430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.789710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:02.827186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82483-2e9a-478c-b760-d4b3354d7620 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.860156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.860842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.861120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.861391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.874373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56e7e3-858d-4706-afab-bbd13210afb2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:02.907836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:02.908738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:02.909018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:02.909293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:02.910475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] RBAC: Authorizing `identity:get_project(project_id=e320519e7fa343bd8b5a8a76c7e69801)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.912342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.914066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 538/1091] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:02.919825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:02.928722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:02.930154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:02.947538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:02.999145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:03.020688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eadec-8766-425a-bd7f-c885050bfd33 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:03.041313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 554/1092] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:53:03.047055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:03.054138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:03.055033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:03.055306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:03.055571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801/users/ae8f39a899a24790be974107352d7a6c/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:03.057547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] RBAC: Authorizing `identity:create_grant(project_id=e320519e7fa343bd8b5a8a76c7e69801, user_id=ae8f39a899a24790be974107352d7a6c, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:03.058961 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:03.073696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 539/1093] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:53:02 2022] PUT /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801/users/ae8f39a899a24790be974107352d7a6c/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:53:03.152038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3737e-d545-4500-8674-6ea441c7b5b9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:03.170898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:03.191792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:03.192520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:03.192821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:03.193088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:03.204955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:03.206485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:53:03.225969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:03.227167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:03.228101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:53:03.228101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:53:03.228101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:53:03.228101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:03.228101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 555/1094] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:53:03.233151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:03.343374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d70da5-c88e-46ca-8ff4-296f02c9ed3e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:03.378115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:03.378769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:03.379048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:03.379337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:03.380042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:03.380345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:03.381754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:03.388695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:03.394416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 540/1095] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:03.400218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:03.504870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab650-53b9-4c4f-85fa-adf9b5b8809d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:03.540285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:03.541120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:03.541405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:03.541663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:03.548586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:03.550072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:53:03.563726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:03.564858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:53:03.566064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:03.568977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 556/1096] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:03.570806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:03.670408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cea930-fae7-445b-9822-cd26f251d5db None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:03.705073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b170b1-d42d-4be3-b21f-9af13285c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:03.705721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b170b1-d42d-4be3-b21f-9af13285c12d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:03.706000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b170b1-d42d-4be3-b21f-9af13285c12d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:03.706256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b170b1-d42d-4be3-b21f-9af13285c12d None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:03.707037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b170b1-d42d-4be3-b21f-9af13285c12d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:03.707351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b170b1-d42d-4be3-b21f-9af13285c12d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:03.708817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b170b1-d42d-4be3-b21f-9af13285c12d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:03.720493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 541/1097] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:03.726676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:03.756454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:03.831326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c9c81-295c-4a08-a67f-81ef0e9ef6f7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:03.867849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb933a-5b75-4462-bcca-65aeb175be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:03.868512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb933a-5b75-4462-bcca-65aeb175be46 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:03.868820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb933a-5b75-4462-bcca-65aeb175be46 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:03.869092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb933a-5b75-4462-bcca-65aeb175be46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:03.869921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb933a-5b75-4462-bcca-65aeb175be46 None admin] RBAC: Adding query filter params (role.id=0d8ba816c5924e298c6b02aa4ed28600, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=7d4f967c85db412aacf6c8b441dbdeb1) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:03.870196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb933a-5b75-4462-bcca-65aeb175be46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:03.871816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb933a-5b75-4462-bcca-65aeb175be46 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:03.878325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 557/1098] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:03 2022] GET /identity/v3/role_assignments?user.id=7d4f967c85db412aacf6c8b441dbdeb1&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=0d8ba816c5924e298c6b02aa4ed28600 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:05.249453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48cd95-78b3-4d18-acf0-224ad4c45e87 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:05.250292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48cd95-78b3-4d18-acf0-224ad4c45e87 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:05.250292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48cd95-78b3-4d18-acf0-224ad4c45e87 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:05.252476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 542/1099] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:05.257965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e41e3-4dd5-41a7-bacb-5011cbb76f2b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:05.258376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e41e3-4dd5-41a7-bacb-5011cbb76f2b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:05.258467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e41e3-4dd5-41a7-bacb-5011cbb76f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:05.276920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bd9e41e3-4dd5-41a7-bacb-5011cbb76f2b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:05.278110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bd9e41e3-4dd5-41a7-bacb-5011cbb76f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:05.357190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 558/1100] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:05.383180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48cd95-78b3-4d18-acf0-224ad4c45e87 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:05.453417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:05.500118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48cd95-78b3-4d18-acf0-224ad4c45e87 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:05.536412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:05.537540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:05.537818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:05.538082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:05.549132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:05.556782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:05.557750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:05.558688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 543/1101] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:05.566963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e41e3-4dd5-41a7-bacb-5011cbb76f2b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:05.596926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:05.673994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e41e3-4dd5-41a7-bacb-5011cbb76f2b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:05.712582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:05.713277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:05.713560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:05.713923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:05.714682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:05.715029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:05.716404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:05.725735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 559/1102] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:05.734031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:05.841415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbc653-2f63-4562-9dd9-f383d105be36 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:05.859017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:05.877542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:05.878406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:05.878681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:05.878950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] PATH_INFO: `/v3/users/ae8f39a899a24790be974107352d7a6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:05.880229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] RBAC: Authorizing `identity:get_user(user_id=ae8f39a899a24790be974107352d7a6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:05.881658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:05.883306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 544/1103] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:05 2022] GET /identity/v3/users/ae8f39a899a24790be974107352d7a6c => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:05.889167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:05.974720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:06.003573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1eeacd-1371-45df-b6f9-275d2bdebc67 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:06.040324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:06.040989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:06.041269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:06.041535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:06.110543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:06.111926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:06.199203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:06.222171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 560/1104] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:06.231496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:06.336764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c556fc-02d3-4b4f-b35b-097e94556f69 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:06.372742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a6f27-39f5-4f0c-8cac-618c5c28ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:06.373545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6f27-39f5-4f0c-8cac-618c5c28ad7c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:06.373818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6f27-39f5-4f0c-8cac-618c5c28ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:06.374081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6f27-39f5-4f0c-8cac-618c5c28ad7c None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:06.375357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a6f27-39f5-4f0c-8cac-618c5c28ad7c None admin] RBAC: Authorizing `identity:get_project(project_id=e320519e7fa343bd8b5a8a76c7e69801)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:06.376802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a6f27-39f5-4f0c-8cac-618c5c28ad7c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:06.378468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 545/1105] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:06 2022] GET /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:06.384827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:06.492516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a39a9-e25c-4eed-a83b-11b19a5ee615 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:06.527385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c77ef-1a87-41a8-90f7-90a99d85b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:06.528033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c77ef-1a87-41a8-90f7-90a99d85b6ff None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:06.528308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c77ef-1a87-41a8-90f7-90a99d85b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:06.528576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c77ef-1a87-41a8-90f7-90a99d85b6ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:06.529427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c77ef-1a87-41a8-90f7-90a99d85b6ff None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=e320519e7fa343bd8b5a8a76c7e69801, user.id=ae8f39a899a24790be974107352d7a6c) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:06.529730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c77ef-1a87-41a8-90f7-90a99d85b6ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:06.531156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c77ef-1a87-41a8-90f7-90a99d85b6ff None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:06.537305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 561/1106] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:06 2022] GET /identity/v3/role_assignments?user.id=ae8f39a899a24790be974107352d7a6c&scope.project.id=e320519e7fa343bd8b5a8a76c7e69801&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:08.729412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e7a0-a724-4697-9ce3-1b4e5131c68f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:08.730278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e7a0-a724-4697-9ce3-1b4e5131c68f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:08.730278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e7a0-a724-4697-9ce3-1b4e5131c68f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:08.732522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 546/1107] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:08.737955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594178-9ba3-408a-9854-278089d792c2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:08.738422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594178-9ba3-408a-9854-278089d792c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:08.738520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594178-9ba3-408a-9854-278089d792c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:08.757332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-00594178-9ba3-408a-9854-278089d792c2 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:08.758416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-00594178-9ba3-408a-9854-278089d792c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:08.806467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:08.831163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 562/1108] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:08.856061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e7a0-a724-4697-9ce3-1b4e5131c68f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:08.926046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:08.978584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e7a0-a724-4697-9ce3-1b4e5131c68f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:09.020603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb4f6-44d7-4768-87b8-0eb759ff3d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:09.021723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb4f6-44d7-4768-87b8-0eb759ff3d6a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:09.022220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb4f6-44d7-4768-87b8-0eb759ff3d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:09.022680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb4f6-44d7-4768-87b8-0eb759ff3d6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:09.024809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb4f6-44d7-4768-87b8-0eb759ff3d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:09.027144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb4f6-44d7-4768-87b8-0eb759ff3d6a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:09.029774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 547/1109] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:53:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:09.040138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594178-9ba3-408a-9854-278089d792c2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:09.161282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594178-9ba3-408a-9854-278089d792c2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:09.197201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49f14f-3ecb-4152-87c3-9db77e84cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:09.197967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49f14f-3ecb-4152-87c3-9db77e84cf36 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:09.198242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49f14f-3ecb-4152-87c3-9db77e84cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:09.198487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49f14f-3ecb-4152-87c3-9db77e84cf36 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:09.199222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49f14f-3ecb-4152-87c3-9db77e84cf36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:09.200671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49f14f-3ecb-4152-87c3-9db77e84cf36 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:09.226743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 563/1110] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:53:09 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:53:11.463682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f8a6d-fb2e-418b-a9e0-6cac14046424 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:11.464243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f8a6d-fb2e-418b-a9e0-6cac14046424 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:11.464243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f8a6d-fb2e-418b-a9e0-6cac14046424 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:11.465648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 548/1111] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:11.472158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb179a-882e-45d6-8815-c57006ae5085 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:11.472963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb179a-882e-45d6-8815-c57006ae5085 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:11.473208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb179a-882e-45d6-8815-c57006ae5085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:11.497160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5abb179a-882e-45d6-8815-c57006ae5085 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:11.498332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5abb179a-882e-45d6-8815-c57006ae5085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:11.531328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:11.575021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 564/1112] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:11.598316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f8a6d-fb2e-418b-a9e0-6cac14046424 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:11.716579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f8a6d-fb2e-418b-a9e0-6cac14046424 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:11.740451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:11.759501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:11.760358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:11.760629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:11.760926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] PATH_INFO: `/v3/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:11.762588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] RBAC: Authorizing `identity:get_role(role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:11.763971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:11.765354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 549/1113] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:11 2022] GET /identity/v3/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:11.771548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb179a-882e-45d6-8815-c57006ae5085 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:11.886414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb179a-882e-45d6-8815-c57006ae5085 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:11.924135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:11.925017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:11.925296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:11.925563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] PATH_INFO: `/v3/users/f7bc79d4adcf41279b98c789bc6873b5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:11.942901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] RBAC: Authorizing `identity:get_user(user_id=f7bc79d4adcf41279b98c789bc6873b5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:11.946148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:11.947831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 565/1114] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:11 2022] GET /identity/v3/users/f7bc79d4adcf41279b98c789bc6873b5 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:11.956749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:12.065879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0783b-d43c-4718-a03c-b07d30825497 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:12.100968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:12.101588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:12.101862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:12.102129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:12.166631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:12.179305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:12.180777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:12.296407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 550/1115] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:12.302850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:12.329241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:12.430865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b46453-2515-44ff-bed5-eb8d92d38cfd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:12.465411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735d96b-2e8d-4d4c-b315-54d8e5baeb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:12.468536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d96b-2e8d-4d4c-b315-54d8e5baeb21 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:12.468536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d96b-2e8d-4d4c-b315-54d8e5baeb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:12.468536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d96b-2e8d-4d4c-b315-54d8e5baeb21 None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:12.468536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735d96b-2e8d-4d4c-b315-54d8e5baeb21 None admin] RBAC: Authorizing `identity:get_project(project_id=e320519e7fa343bd8b5a8a76c7e69801)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:12.469416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735d96b-2e8d-4d4c-b315-54d8e5baeb21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:12.471292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 566/1116] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:12 2022] GET /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:12.478482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:12.582990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:12.593364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf753-de50-42af-a978-ab4f340f7a1b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:12.632391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084422e-fc7e-4f99-b965-fcb618869f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:12.633062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084422e-fc7e-4f99-b965-fcb618869f52 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:12.633308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084422e-fc7e-4f99-b965-fcb618869f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:12.633600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084422e-fc7e-4f99-b965-fcb618869f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:12.634422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084422e-fc7e-4f99-b965-fcb618869f52 None admin] RBAC: Adding query filter params (role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=e320519e7fa343bd8b5a8a76c7e69801, user.id=f7bc79d4adcf41279b98c789bc6873b5) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:12.634727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084422e-fc7e-4f99-b965-fcb618869f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:12.636154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084422e-fc7e-4f99-b965-fcb618869f52 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:12.642080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 551/1117] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:12 2022] GET /identity/v3/role_assignments?user.id=f7bc79d4adcf41279b98c789bc6873b5&scope.project.id=e320519e7fa343bd8b5a8a76c7e69801&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:14.838681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fbc48-1531-4d2a-9556-9e3ea36f0a1c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:14.839219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fbc48-1531-4d2a-9556-9e3ea36f0a1c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:14.839219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fbc48-1531-4d2a-9556-9e3ea36f0a1c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:14.840616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 567/1118] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:14.846960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d59cd-6fb4-4e33-8c48-77707e149ac0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:14.847793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d59cd-6fb4-4e33-8c48-77707e149ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:14.847967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d59cd-6fb4-4e33-8c48-77707e149ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:14.877034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7a1d59cd-6fb4-4e33-8c48-77707e149ac0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:14.878904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7a1d59cd-6fb4-4e33-8c48-77707e149ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:14.948114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 552/1119] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:14.980058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fbc48-1531-4d2a-9556-9e3ea36f0a1c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:15.079152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:15.090366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fbc48-1531-4d2a-9556-9e3ea36f0a1c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:15.132818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:15.133671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:15.133948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:15.134209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] PATH_INFO: `/v3/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:15.135704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] RBAC: Authorizing `identity:get_role(role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:15.137098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:15.138454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 568/1120] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:14 2022] GET /identity/v3/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:15.145368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d59cd-6fb4-4e33-8c48-77707e149ac0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:15.251677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:15.276809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d59cd-6fb4-4e33-8c48-77707e149ac0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:15.311817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:15.312683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:15.312989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:15.313246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] PATH_INFO: `/v3/users/f7bc79d4adcf41279b98c789bc6873b5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:15.314446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] RBAC: Authorizing `identity:get_user(user_id=f7bc79d4adcf41279b98c789bc6873b5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:15.315875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:15.317539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 553/1121] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:15 2022] GET /identity/v3/users/f7bc79d4adcf41279b98c789bc6873b5 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:15.323573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:15.430422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714132ac-4d8a-4ede-bd1d-2ae32c408991 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:15.465010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce034ece-a528-4918-bf84-1f96193fce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:15.465868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce034ece-a528-4918-bf84-1f96193fce67 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:15.466142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce034ece-a528-4918-bf84-1f96193fce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:15.466410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce034ece-a528-4918-bf84-1f96193fce67 None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:15.467599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce034ece-a528-4918-bf84-1f96193fce67 None admin] RBAC: Authorizing `identity:get_project(project_id=e320519e7fa343bd8b5a8a76c7e69801)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:15.469072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce034ece-a528-4918-bf84-1f96193fce67 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:15.470756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 569/1122] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:15 2022] GET /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:15.477049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:15.583118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6eda3-a890-4000-bceb-f29a045d2b8c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:15.631154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439b572-4279-4e1a-88f2-eb24cf3b7333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:15.632044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b572-4279-4e1a-88f2-eb24cf3b7333 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:15.632328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b572-4279-4e1a-88f2-eb24cf3b7333 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:15.632599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b572-4279-4e1a-88f2-eb24cf3b7333 None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801/users/f7bc79d4adcf41279b98c789bc6873b5/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:15.635366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439b572-4279-4e1a-88f2-eb24cf3b7333 None admin] RBAC: Authorizing `identity:create_grant(project_id=e320519e7fa343bd8b5a8a76c7e69801, user_id=f7bc79d4adcf41279b98c789bc6873b5, role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:15.636849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439b572-4279-4e1a-88f2-eb24cf3b7333 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:15.653528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 554/1123] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:53:15 2022] PUT /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801/users/f7bc79d4adcf41279b98c789bc6873b5/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:53:17.818875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63bc6-df51-41b8-856c-86e8c0847684 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:17.819414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63bc6-df51-41b8-856c-86e8c0847684 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:17.819414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63bc6-df51-41b8-856c-86e8c0847684 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:17.820807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 570/1124] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:17.827111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b9e4-493a-41ce-9035-0d8a49c06eb5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:17.827860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b9e4-493a-41ce-9035-0d8a49c06eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:17.827990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b9e4-493a-41ce-9035-0d8a49c06eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:17.852767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-78a1b9e4-493a-41ce-9035-0d8a49c06eb5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:17.853942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-78a1b9e4-493a-41ce-9035-0d8a49c06eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:17.861226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:17.928042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 555/1125] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:17.951125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b63bc6-df51-41b8-856c-86e8c0847684 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:17.979548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:18.058727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b63bc6-df51-41b8-856c-86e8c0847684 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:18.094127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:18.094918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:18.095190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:18.095459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] PATH_INFO: `/v3/roles/bc7b7d6c0a514713b5d0fa139476e425` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:18.097104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] RBAC: Authorizing `identity:get_role(role_id=bc7b7d6c0a514713b5d0fa139476e425)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:18.098484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:18.099858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 571/1126] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:17 2022] GET /identity/v3/roles/bc7b7d6c0a514713b5d0fa139476e425 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:18.105857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b9e4-493a-41ce-9035-0d8a49c06eb5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:18.210306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b9e4-493a-41ce-9035-0d8a49c06eb5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:18.246098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:18.246958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:18.247234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:18.247513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] PATH_INFO: `/v3/users/f7bc79d4adcf41279b98c789bc6873b5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:18.248846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] RBAC: Authorizing `identity:get_user(user_id=f7bc79d4adcf41279b98c789bc6873b5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:18.250284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:18.251908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 556/1127] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:18 2022] GET /identity/v3/users/f7bc79d4adcf41279b98c789bc6873b5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:18.257937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:18.358729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:18.366711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44521-ce2c-49d4-a34c-ccb96e7f5c68 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:18.401493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:18.402142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:18.402424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:18.402699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:18.478137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:18.479588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:18.579832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:18.592295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 572/1128] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:18.600235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:18.612998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:18.708625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4287-8455-480e-a404-b4269df6dfd4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:18.749237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac7ae4-c935-42e2-a2ce-c812cdb8f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:18.750076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac7ae4-c935-42e2-a2ce-c812cdb8f8cf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:18.750353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac7ae4-c935-42e2-a2ce-c812cdb8f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:18.750619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac7ae4-c935-42e2-a2ce-c812cdb8f8cf None admin] PATH_INFO: `/v3/projects/e320519e7fa343bd8b5a8a76c7e69801` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:18.751908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac7ae4-c935-42e2-a2ce-c812cdb8f8cf None admin] RBAC: Authorizing `identity:get_project(project_id=e320519e7fa343bd8b5a8a76c7e69801)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:18.753435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac7ae4-c935-42e2-a2ce-c812cdb8f8cf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:18.755134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 557/1129] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:18 2022] GET /identity/v3/projects/e320519e7fa343bd8b5a8a76c7e69801 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:18.765079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:18.877438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abaded-55a7-492b-9bfa-0629e09630bf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:18.910569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8d8e6-b62a-4d6b-b89e-29e84310d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:18.911529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8d8e6-b62a-4d6b-b89e-29e84310d42e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:18.911804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8d8e6-b62a-4d6b-b89e-29e84310d42e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:18.912068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8d8e6-b62a-4d6b-b89e-29e84310d42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:18.912921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8d8e6-b62a-4d6b-b89e-29e84310d42e None admin] RBAC: Adding query filter params (role.id=bc7b7d6c0a514713b5d0fa139476e425, scope.project.id=e320519e7fa343bd8b5a8a76c7e69801, user.id=f7bc79d4adcf41279b98c789bc6873b5) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:18.913227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8d8e6-b62a-4d6b-b89e-29e84310d42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:18.914659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8d8e6-b62a-4d6b-b89e-29e84310d42e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:18.920262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 573/1130] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:18 2022] GET /identity/v3/role_assignments?user.id=f7bc79d4adcf41279b98c789bc6873b5&scope.project.id=e320519e7fa343bd8b5a8a76c7e69801&role.id=bc7b7d6c0a514713b5d0fa139476e425 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:21.158316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eda00a-5a8f-4b27-9f7c-36f36deec56e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:21.159198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eda00a-5a8f-4b27-9f7c-36f36deec56e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:21.159198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eda00a-5a8f-4b27-9f7c-36f36deec56e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:21.161800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 558/1131] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:21.168086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a21f9-4b0d-4139-a468-2beaa58ef552 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:21.168501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a21f9-4b0d-4139-a468-2beaa58ef552 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:21.168611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a21f9-4b0d-4139-a468-2beaa58ef552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:21.188823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d79a21f9-4b0d-4139-a468-2beaa58ef552 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:21.190009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d79a21f9-4b0d-4139-a468-2beaa58ef552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:21.252014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:21.268025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 574/1132] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:21.292040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eda00a-5a8f-4b27-9f7c-36f36deec56e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:21.382578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:21.407152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eda00a-5a8f-4b27-9f7c-36f36deec56e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:21.443824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ded90-02da-4251-9827-2e5988fc6523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:21.444529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ded90-02da-4251-9827-2e5988fc6523 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:21.444841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ded90-02da-4251-9827-2e5988fc6523 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:21.445114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ded90-02da-4251-9827-2e5988fc6523 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:21.446403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ded90-02da-4251-9827-2e5988fc6523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:21.447979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ded90-02da-4251-9827-2e5988fc6523 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:21.449628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 559/1133] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:53:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:21.456232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a21f9-4b0d-4139-a468-2beaa58ef552 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:21.575268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a21f9-4b0d-4139-a468-2beaa58ef552 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:21.609902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840614e2-1ad9-4df3-be65-f782c0870bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:21.610550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840614e2-1ad9-4df3-be65-f782c0870bc0 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:21.610827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840614e2-1ad9-4df3-be65-f782c0870bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:21.611095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840614e2-1ad9-4df3-be65-f782c0870bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:21.611844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840614e2-1ad9-4df3-be65-f782c0870bc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:21.613341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840614e2-1ad9-4df3-be65-f782c0870bc0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:21.642141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 575/1134] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:53:21 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:53:23.889376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc130c20-d504-4811-99cf-f8b50efc5d6f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:23.890317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc130c20-d504-4811-99cf-f8b50efc5d6f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:23.890317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc130c20-d504-4811-99cf-f8b50efc5d6f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:23.892399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 560/1135] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:23.900465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f06e-366e-4c9d-8a46-c04fbf3565e1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:23.900952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f06e-366e-4c9d-8a46-c04fbf3565e1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:23.901043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183f06e-366e-4c9d-8a46-c04fbf3565e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:23.919398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5183f06e-366e-4c9d-8a46-c04fbf3565e1 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:23.920575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5183f06e-366e-4c9d-8a46-c04fbf3565e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:23.956416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:23.991860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 576/1136] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:53:24.016474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc130c20-d504-4811-99cf-f8b50efc5d6f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:24.125507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc130c20-d504-4811-99cf-f8b50efc5d6f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:24.160412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8253118-57e3-4d4e-887b-fd4377ffa8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:24.161454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8253118-57e3-4d4e-887b-fd4377ffa8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:24.161721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8253118-57e3-4d4e-887b-fd4377ffa8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:24.161986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8253118-57e3-4d4e-887b-fd4377ffa8f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:24.163250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8253118-57e3-4d4e-887b-fd4377ffa8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:24.164679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8253118-57e3-4d4e-887b-fd4377ffa8f8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:24.166272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 561/1137] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:53:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:24.174579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f06e-366e-4c9d-8a46-c04fbf3565e1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:24.276977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183f06e-366e-4c9d-8a46-c04fbf3565e1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:24.312518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822fa26-ba31-4ffb-b32d-c01dadbf4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:24.313205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822fa26-ba31-4ffb-b32d-c01dadbf4ca2 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:24.313475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822fa26-ba31-4ffb-b32d-c01dadbf4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:24.313747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822fa26-ba31-4ffb-b32d-c01dadbf4ca2 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:24.314431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822fa26-ba31-4ffb-b32d-c01dadbf4ca2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:24.315940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822fa26-ba31-4ffb-b32d-c01dadbf4ca2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:24.338838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 577/1138] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:53:24 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:53:26.555413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cd85-5c01-4cd2-913c-63be4d291d24 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:26.556209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cd85-5c01-4cd2-913c-63be4d291d24 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:26.556319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cd85-5c01-4cd2-913c-63be4d291d24 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:26.558672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 562/1139] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:26.564973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252050-eb86-41ea-9671-4379b7d22aed None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:26.565442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252050-eb86-41ea-9671-4379b7d22aed None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:26.565569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252050-eb86-41ea-9671-4379b7d22aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:26.589264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-98252050-eb86-41ea-9671-4379b7d22aed None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:26.590441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-98252050-eb86-41ea-9671-4379b7d22aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:26.610650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:26.669554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 578/1140] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:26.692786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cd85-5c01-4cd2-913c-63be4d291d24 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:26.709325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:26.805583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cd85-5c01-4cd2-913c-63be4d291d24 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:26.839965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:26.840765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:26.841040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:26.841304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:26.852102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:26.859664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:26.860776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:26.861681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 563/1141] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:26.867823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98252050-eb86-41ea-9671-4379b7d22aed None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:26.970474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98252050-eb86-41ea-9671-4379b7d22aed None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:27.005382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:27.006028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:27.006312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:27.006571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:27.007316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:27.007616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:27.009014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:27.017099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 579/1142] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:27.025977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:27.107617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:27.135847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b604-c3bd-4c23-9a37-4f244237375f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:27.171067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:27.171922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:27.172195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:27.172463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] PATH_INFO: `/v3/users/f62de816e7f34dde9a1ef2e2d4d7aa96` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:27.186022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] RBAC: Authorizing `identity:get_user(user_id=f62de816e7f34dde9a1ef2e2d4d7aa96)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:27.187466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:27.189140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 564/1143] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:27 2022] GET /identity/v3/users/f62de816e7f34dde9a1ef2e2d4d7aa96 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:27.196023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:27.219480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:27.312130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131201f1-f3fe-4048-ba63-91931d005fda None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:27.347687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:27.348322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:27.348597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:27.348897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:27.419030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:27.420410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:27.438408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:27.517840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 580/1144] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:27.523901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:27.646124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f857-3298-457c-87be-2ff388b35f9e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:27.678968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:27.685169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f4a38-ebeb-45da-b3ae-33e157198bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:27.686020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4a38-ebeb-45da-b3ae-33e157198bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:27.686292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4a38-ebeb-45da-b3ae-33e157198bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:27.686560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4a38-ebeb-45da-b3ae-33e157198bc1 None admin] PATH_INFO: `/v3/projects/4465b73196da4d4b92ac78483346043c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:27.687842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f4a38-ebeb-45da-b3ae-33e157198bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=4465b73196da4d4b92ac78483346043c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:27.689296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f4a38-ebeb-45da-b3ae-33e157198bc1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:27.691059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 565/1145] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:27 2022] GET /identity/v3/projects/4465b73196da4d4b92ac78483346043c => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:27.697409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:27.806673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76fc46-f19d-4268-a633-7eff7df1003e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:27.825137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:27.842399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce525b5-adff-4208-89fb-a065add730ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:27.843040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce525b5-adff-4208-89fb-a065add730ae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:27.843312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce525b5-adff-4208-89fb-a065add730ae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:27.843583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce525b5-adff-4208-89fb-a065add730ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:27.844408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce525b5-adff-4208-89fb-a065add730ae None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=4465b73196da4d4b92ac78483346043c, user.id=f62de816e7f34dde9a1ef2e2d4d7aa96) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:27.844750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce525b5-adff-4208-89fb-a065add730ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:27.846170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce525b5-adff-4208-89fb-a065add730ae None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:27.851568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 581/1146] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:27 2022] GET /identity/v3/role_assignments?user.id=f62de816e7f34dde9a1ef2e2d4d7aa96&scope.project.id=4465b73196da4d4b92ac78483346043c&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:29.976702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563365-9929-47b3-9782-9ec3d2668125 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:29.977546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563365-9929-47b3-9782-9ec3d2668125 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:29.977681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563365-9929-47b3-9782-9ec3d2668125 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:29.979749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 566/1147] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:29.989112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5849-91e8-454c-a8eb-df65b782c9b0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:29.989831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5849-91e8-454c-a8eb-df65b782c9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:29.989972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5849-91e8-454c-a8eb-df65b782c9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:30.012920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3bbd5849-91e8-454c-a8eb-df65b782c9b0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:30.014103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3bbd5849-91e8-454c-a8eb-df65b782c9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:30.084510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 582/1148] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:30.107319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1563365-9929-47b3-9782-9ec3d2668125 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:30.223172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1563365-9929-47b3-9782-9ec3d2668125 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:30.260538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:30.261358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:30.261630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:30.261909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:30.272148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:30.280191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:30.281208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:30.282060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 567/1149] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:30.288581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5849-91e8-454c-a8eb-df65b782c9b0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:30.391300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5849-91e8-454c-a8eb-df65b782c9b0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:30.404414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:30.428835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:30.429857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:30.430295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:30.430864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:30.432090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:30.432565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:30.434770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:30.449171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 583/1150] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:30.455898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:30.518302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:30.564735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd76496-08e8-4eea-bf32-2f4d552044ae None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:30.602182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:30.603053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:30.603303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:30.603598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] PATH_INFO: `/v3/users/f62de816e7f34dde9a1ef2e2d4d7aa96` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:30.604951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] RBAC: Authorizing `identity:get_user(user_id=f62de816e7f34dde9a1ef2e2d4d7aa96)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:30.606407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:30.608047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 568/1151] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:30 2022] GET /identity/v3/users/f62de816e7f34dde9a1ef2e2d4d7aa96 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:30.614044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:30.721895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f850e-12f2-40ee-9d73-6cb03b85add0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:30.756285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6762ad-737c-460e-a41b-6f8b98748820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:30.757146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6762ad-737c-460e-a41b-6f8b98748820 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:30.757417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6762ad-737c-460e-a41b-6f8b98748820 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:30.757682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6762ad-737c-460e-a41b-6f8b98748820 None admin] PATH_INFO: `/v3/projects/4465b73196da4d4b92ac78483346043c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:30.758975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6762ad-737c-460e-a41b-6f8b98748820 None admin] RBAC: Authorizing `identity:get_project(project_id=4465b73196da4d4b92ac78483346043c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:30.760453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6762ad-737c-460e-a41b-6f8b98748820 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:30.762174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 584/1152] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:30 2022] GET /identity/v3/projects/4465b73196da4d4b92ac78483346043c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:30.771081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:30.880871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f9b0d-faac-48ca-a49c-3d0777300b57 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:30.908557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:30.917576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0da5a3-8726-4923-bc73-350ceed18e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:30.918461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0da5a3-8726-4923-bc73-350ceed18e44 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:30.918735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0da5a3-8726-4923-bc73-350ceed18e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:30.919013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0da5a3-8726-4923-bc73-350ceed18e44 None admin] PATH_INFO: `/v3/projects/4465b73196da4d4b92ac78483346043c/users/f62de816e7f34dde9a1ef2e2d4d7aa96/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:30.921031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0da5a3-8726-4923-bc73-350ceed18e44 None admin] RBAC: Authorizing `identity:create_grant(project_id=4465b73196da4d4b92ac78483346043c, user_id=f62de816e7f34dde9a1ef2e2d4d7aa96, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:30.922456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0da5a3-8726-4923-bc73-350ceed18e44 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:30.937790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 569/1153] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:53:30 2022] PUT /identity/v3/projects/4465b73196da4d4b92ac78483346043c/users/f62de816e7f34dde9a1ef2e2d4d7aa96/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:53:33.085149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb58c5-fad6-4a8d-9168-1953002a8074 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:33.086059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb58c5-fad6-4a8d-9168-1953002a8074 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:33.086059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb58c5-fad6-4a8d-9168-1953002a8074 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:33.088212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 585/1154] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:33.094695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b492497-ffe4-4a06-bee8-e1d85059f870 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:33.095432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b492497-ffe4-4a06-bee8-e1d85059f870 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:33.095599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b492497-ffe4-4a06-bee8-e1d85059f870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:33.119616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4b492497-ffe4-4a06-bee8-e1d85059f870 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:33.120835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4b492497-ffe4-4a06-bee8-e1d85059f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:33.193867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 570/1155] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:33.217888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb58c5-fad6-4a8d-9168-1953002a8074 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:33.271458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:33.340392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb58c5-fad6-4a8d-9168-1953002a8074 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:33.375818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:33.376598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:33.376906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:33.377173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:33.387840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:33.395497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:33.396599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:33.397969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 586/1156] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:33.405721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b492497-ffe4-4a06-bee8-e1d85059f870 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:33.523616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b492497-ffe4-4a06-bee8-e1d85059f870 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:33.544742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:33.564055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:33.564841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:33.565127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:33.565401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:33.566142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:33.566444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:33.567821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:33.576586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 571/1157] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:33.582669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:33.697347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517434e8-387f-4fac-ba1d-91d92a0331f5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:33.698792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:33.734576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:33.735440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:33.735711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:33.735972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] PATH_INFO: `/v3/users/f62de816e7f34dde9a1ef2e2d4d7aa96` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:33.737242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] RBAC: Authorizing `identity:get_user(user_id=f62de816e7f34dde9a1ef2e2d4d7aa96)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:33.738715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:33.740339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 587/1158] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:33 2022] GET /identity/v3/users/f62de816e7f34dde9a1ef2e2d4d7aa96 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:33.746279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:33.850811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009b45-b436-4c8b-9dcb-7c41b63b7171 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:33.886192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:33.886836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:33.887113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:33.887389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:33.940148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:33.962514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:33.963901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:34.071007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 572/1159] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:34.080899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:34.197724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b0659-c749-4653-aefb-ad1d0bd7c2f6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:34.234223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9db19-8677-48d8-8d27-46e3d4931976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:34.235018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9db19-8677-48d8-8d27-46e3d4931976 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:34.235300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9db19-8677-48d8-8d27-46e3d4931976 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:34.235567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9db19-8677-48d8-8d27-46e3d4931976 None admin] PATH_INFO: `/v3/projects/4465b73196da4d4b92ac78483346043c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:34.236894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9db19-8677-48d8-8d27-46e3d4931976 None admin] RBAC: Authorizing `identity:get_project(project_id=4465b73196da4d4b92ac78483346043c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:34.238346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9db19-8677-48d8-8d27-46e3d4931976 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:34.240045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 588/1160] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:34 2022] GET /identity/v3/projects/4465b73196da4d4b92ac78483346043c => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:34.246901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:34.332294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:34.355549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f4a3-9643-4b1c-a269-0270650501af None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:34.395219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100ad6-104a-4218-821b-df2846bde056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:34.396008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100ad6-104a-4218-821b-df2846bde056 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:34.396443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100ad6-104a-4218-821b-df2846bde056 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:34.396833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100ad6-104a-4218-821b-df2846bde056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:34.397728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100ad6-104a-4218-821b-df2846bde056 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=4465b73196da4d4b92ac78483346043c, user.id=f62de816e7f34dde9a1ef2e2d4d7aa96) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:34.398041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100ad6-104a-4218-821b-df2846bde056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:34.399666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100ad6-104a-4218-821b-df2846bde056 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:34.405997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 573/1161] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:34 2022] GET /identity/v3/role_assignments?user.id=f62de816e7f34dde9a1ef2e2d4d7aa96&scope.project.id=4465b73196da4d4b92ac78483346043c&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:36.598987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870435e-cdfc-4e3c-9cec-cfc2a75187a9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:36.599824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870435e-cdfc-4e3c-9cec-cfc2a75187a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:36.599824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870435e-cdfc-4e3c-9cec-cfc2a75187a9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:36.602155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 589/1162] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:36.607556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50508838-0070-4808-b0ba-38d610cd87e3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:36.607985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50508838-0070-4808-b0ba-38d610cd87e3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:36.608092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50508838-0070-4808-b0ba-38d610cd87e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:36.626720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-50508838-0070-4808-b0ba-38d610cd87e3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:36.627963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-50508838-0070-4808-b0ba-38d610cd87e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:36.696930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 574/1163] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:36.718975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870435e-cdfc-4e3c-9cec-cfc2a75187a9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:36.771349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:36.839257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870435e-cdfc-4e3c-9cec-cfc2a75187a9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:36.876312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:36.876962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:36.877274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:36.877537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:36.949034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:36.950473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:36.988665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:37.050321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 590/1164] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:37.056579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50508838-0070-4808-b0ba-38d610cd87e3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:37.133341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:37.162153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50508838-0070-4808-b0ba-38d610cd87e3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:37.197690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114e4b1-4092-4fec-aef5-35e51138b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:37.198475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e4b1-4092-4fec-aef5-35e51138b16b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:37.198727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e4b1-4092-4fec-aef5-35e51138b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:37.199008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e4b1-4092-4fec-aef5-35e51138b16b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:37.205765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114e4b1-4092-4fec-aef5-35e51138b16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:37.207203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114e4b1-4092-4fec-aef5-35e51138b16b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f114e4b1-4092-4fec-aef5-35e51138b16b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:37.221576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:37.222904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 575/1165] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:53:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:37.229555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:37.343342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4c5db-851f-4188-a691-5357a4245b48 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:37.378082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349498db-7492-4c81-b7c8-3257254bed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:37.378734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349498db-7492-4c81-b7c8-3257254bed6c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:37.379014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349498db-7492-4c81-b7c8-3257254bed6c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:37.379287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349498db-7492-4c81-b7c8-3257254bed6c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:37.380008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349498db-7492-4c81-b7c8-3257254bed6c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:37.380314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349498db-7492-4c81-b7c8-3257254bed6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:37.381726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349498db-7492-4c81-b7c8-3257254bed6c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:37.389043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 591/1166] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 11:53:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:39.537512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510c49-595e-4f2e-add8-72b6b57c59df None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:39.537995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510c49-595e-4f2e-add8-72b6b57c59df None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:39.537995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510c49-595e-4f2e-add8-72b6b57c59df None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:39.539443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 576/1167] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:39.545874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06b1d9-768c-4ec6-84e6-4e8a2fa63b3c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:39.546638 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06b1d9-768c-4ec6-84e6-4e8a2fa63b3c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:39.546742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06b1d9-768c-4ec6-84e6-4e8a2fa63b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:39.555587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:39.572621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7b06b1d9-768c-4ec6-84e6-4e8a2fa63b3c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:39.573857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7b06b1d9-768c-4ec6-84e6-4e8a2fa63b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:39.647292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 592/1168] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:39.670322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce510c49-595e-4f2e-add8-72b6b57c59df None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:39.773439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce510c49-595e-4f2e-add8-72b6b57c59df None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:39.808791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f38c9e-cb07-42bb-a66a-56166791fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:39.809431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38c9e-cb07-42bb-a66a-56166791fbc0 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:39.809704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38c9e-cb07-42bb-a66a-56166791fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:39.809971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38c9e-cb07-42bb-a66a-56166791fbc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:39.810703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f38c9e-cb07-42bb-a66a-56166791fbc0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:39.812060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f38c9e-cb07-42bb-a66a-56166791fbc0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:39.814679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:39.832079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 577/1169] 10.222.0.35 () {60 vars in 1138 bytes} [Thu May 19 11:53:39 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:53:42.052262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c2c9-89b6-454e-9e20-2c05e866ebb1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:42.053156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c2c9-89b6-454e-9e20-2c05e866ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:42.053327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c2c9-89b6-454e-9e20-2c05e866ebb1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:42.055343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 593/1170] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:42.061679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212faa6-e3f4-4a5e-b00b-dd68e71ed98a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:42.062399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212faa6-e3f4-4a5e-b00b-dd68e71ed98a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:42.062536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212faa6-e3f4-4a5e-b00b-dd68e71ed98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:42.081441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d212faa6-e3f4-4a5e-b00b-dd68e71ed98a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:42.082618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d212faa6-e3f4-4a5e-b00b-dd68e71ed98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:42.155788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 578/1171] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:42.186584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437c2c9-89b6-454e-9e20-2c05e866ebb1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:42.307138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437c2c9-89b6-454e-9e20-2c05e866ebb1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:42.338656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:42.344803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de484-6712-4812-97a8-39b851319b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:42.345780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de484-6712-4812-97a8-39b851319b34 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:42.346175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de484-6712-4812-97a8-39b851319b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:42.346548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de484-6712-4812-97a8-39b851319b34 None admin] PATH_INFO: `/v3/domains/ad6629a5a3f3402a9f08c61162ae2f05` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:42.357716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3de484-6712-4812-97a8-39b851319b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ad6629a5a3f3402a9f08c61162ae2f05)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:42.359163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3de484-6712-4812-97a8-39b851319b34 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:42.360808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 594/1172] 10.222.0.35 () {56 vars in 1183 bytes} [Thu May 19 11:53:42 2022] GET /identity/v3/domains/ad6629a5a3f3402a9f08c61162ae2f05 => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:42.367242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212faa6-e3f4-4a5e-b00b-dd68e71ed98a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:42.476601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212faa6-e3f4-4a5e-b00b-dd68e71ed98a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:42.503313 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:42.515960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc86b8-1609-43db-a145-8928ed9dee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:42.516621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc86b8-1609-43db-a145-8928ed9dee13 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:42.516930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc86b8-1609-43db-a145-8928ed9dee13 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:42.517199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc86b8-1609-43db-a145-8928ed9dee13 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:42.517906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc86b8-1609-43db-a145-8928ed9dee13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:42.519349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc86b8-1609-43db-a145-8928ed9dee13 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:42.548466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 579/1173] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:53:42 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:53:44.775187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0de3-5b9b-43a2-87f1-63674efb6dd9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:44.776021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0de3-5b9b-43a2-87f1-63674efb6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:44.776021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0de3-5b9b-43a2-87f1-63674efb6dd9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:44.778216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 595/1174] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:44.784383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9518a1-b523-4b14-a558-a3f178a2d9db None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:44.784816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9518a1-b523-4b14-a558-a3f178a2d9db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:44.784930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9518a1-b523-4b14-a558-a3f178a2d9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:44.803461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1f9518a1-b523-4b14-a558-a3f178a2d9db None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:44.804624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1f9518a1-b523-4b14-a558-a3f178a2d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:44.876201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 580/1175] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:44.914240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0de3-5b9b-43a2-87f1-63674efb6dd9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:45.027760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0de3-5b9b-43a2-87f1-63674efb6dd9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:45.064336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5b2cd-9ecb-402f-94f6-f1026026f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:45.065215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b2cd-9ecb-402f-94f6-f1026026f47d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:45.065497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b2cd-9ecb-402f-94f6-f1026026f47d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:45.065768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b2cd-9ecb-402f-94f6-f1026026f47d None admin] PATH_INFO: `/v3/domains/ad6629a5a3f3402a9f08c61162ae2f05` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:45.067050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5b2cd-9ecb-402f-94f6-f1026026f47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=ad6629a5a3f3402a9f08c61162ae2f05)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:45.068487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5b2cd-9ecb-402f-94f6-f1026026f47d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:45.070182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 596/1176] 10.222.0.35 () {56 vars in 1183 bytes} [Thu May 19 11:53:44 2022] GET /identity/v3/domains/ad6629a5a3f3402a9f08c61162ae2f05 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:45.076213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9518a1-b523-4b14-a558-a3f178a2d9db None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:45.176952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9518a1-b523-4b14-a558-a3f178a2d9db None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:45.184147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:45.215491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56fb3c-24bf-4213-91df-eb9a3f18387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:45.216158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56fb3c-24bf-4213-91df-eb9a3f18387f None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:45.216431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56fb3c-24bf-4213-91df-eb9a3f18387f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:45.216692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56fb3c-24bf-4213-91df-eb9a3f18387f None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:45.217420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56fb3c-24bf-4213-91df-eb9a3f18387f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:45.218848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56fb3c-24bf-4213-91df-eb9a3f18387f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:45.241775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 581/1177] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:53:45 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:53:47.446654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9b9d-5cda-43af-9c26-6e699d9ff1e0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:47.447248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9b9d-5cda-43af-9c26-6e699d9ff1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:47.447248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9b9d-5cda-43af-9c26-6e699d9ff1e0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:47.449575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 597/1178] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:47.457199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07e76-31d0-4f46-8647-1210cf8018e5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:47.457635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07e76-31d0-4f46-8647-1210cf8018e5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:47.457809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07e76-31d0-4f46-8647-1210cf8018e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:47.485187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1cc07e76-31d0-4f46-8647-1210cf8018e5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:47.486602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1cc07e76-31d0-4f46-8647-1210cf8018e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:47.562799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 582/1179] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:47.592920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9b9d-5cda-43af-9c26-6e699d9ff1e0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:47.664200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:47.709141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9b9d-5cda-43af-9c26-6e699d9ff1e0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:47.743993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:47.744792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:47.745071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:47.745334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:47.755356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:47.762778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:47.763839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:47.764736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 598/1180] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:47.770115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc07e76-31d0-4f46-8647-1210cf8018e5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:47.895793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:47.906474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc07e76-31d0-4f46-8647-1210cf8018e5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:47.945411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:47.946069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:47.946346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:47.946616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:47.947396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:47.947704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:47.949121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:47.957472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 583/1181] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:47.967062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:48.074472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ce1c1-fb39-45c8-9f8f-7090671731d6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:48.094015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:48.109800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:48.110684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:48.110983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:48.111247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] PATH_INFO: `/v3/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:48.124514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] RBAC: Authorizing `identity:get_user(user_id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:48.126022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:48.127678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 599/1182] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:47 2022] GET /identity/v3/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:48.133775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:48.235305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdae9c1-be85-4aa5-9a08-52a5b779cdea None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:48.272049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:48.272677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:48.272986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:48.273257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:48.297722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:48.342407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:48.343839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:48.444801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 584/1183] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:48.453518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:48.568620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f6455-b0b7-4289-8833-77ac72965f4e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:48.604503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809f010-b641-455c-a831-55825e30d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:48.605373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f010-b641-455c-a831-55825e30d085 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:48.605649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f010-b641-455c-a831-55825e30d085 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:48.605913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f010-b641-455c-a831-55825e30d085 None admin] PATH_INFO: `/v3/projects/9955a46c82704d04868e8ce62ac7be15` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:48.607191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809f010-b641-455c-a831-55825e30d085 None admin] RBAC: Authorizing `identity:get_project(project_id=9955a46c82704d04868e8ce62ac7be15)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:48.608668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809f010-b641-455c-a831-55825e30d085 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:48.610338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 600/1184] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:48 2022] GET /identity/v3/projects/9955a46c82704d04868e8ce62ac7be15 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:48.619726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:48.679229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:48.724628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e359070-81b9-48c2-ac5b-a215014f1992 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:48.765298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b1f3b-e1dc-4145-8743-230e6b302464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:48.766114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1f3b-e1dc-4145-8743-230e6b302464 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:48.766490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1f3b-e1dc-4145-8743-230e6b302464 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:48.766868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1f3b-e1dc-4145-8743-230e6b302464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:48.768175 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b1f3b-e1dc-4145-8743-230e6b302464 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=9955a46c82704d04868e8ce62ac7be15, user.id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:48.768551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b1f3b-e1dc-4145-8743-230e6b302464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:48.770843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b1f3b-e1dc-4145-8743-230e6b302464 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:48.780207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 585/1185] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:48 2022] GET /identity/v3/role_assignments?user.id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf&scope.project.id=9955a46c82704d04868e8ce62ac7be15&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:50.923638 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838b7b-d46e-433e-9a44-0349b4a40831 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:50.924521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838b7b-d46e-433e-9a44-0349b4a40831 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:50.924521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838b7b-d46e-433e-9a44-0349b4a40831 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:50.926689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 601/1186] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:50.932965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eaa7e-6a4f-4a9a-a637-176bb1149b5b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:50.933709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eaa7e-6a4f-4a9a-a637-176bb1149b5b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:50.933870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eaa7e-6a4f-4a9a-a637-176bb1149b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:50.953748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eb9eaa7e-6a4f-4a9a-a637-176bb1149b5b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:50.954945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eb9eaa7e-6a4f-4a9a-a637-176bb1149b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:51.031636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 586/1187] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:51.067808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34838b7b-d46e-433e-9a44-0349b4a40831 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:51.119999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:51.176378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34838b7b-d46e-433e-9a44-0349b4a40831 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:51.211330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:51.212096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:51.212368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:51.212664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:51.224102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:51.231485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:51.232465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:53:51.233377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 602/1188] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:51.239026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eaa7e-6a4f-4a9a-a637-176bb1149b5b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:51.288485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:51.342646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eaa7e-6a4f-4a9a-a637-176bb1149b5b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:51.376000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:51.376666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:51.376935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:51.377199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:51.377940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:51.378236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:51.379580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:51.387412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 587/1189] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:51.393732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:51.531654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6478e54-a8f9-4937-ac17-28d297ccd850 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:51.539276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:51.572410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:51.573317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:51.573596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:51.573868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] PATH_INFO: `/v3/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:51.575053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] RBAC: Authorizing `identity:get_user(user_id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:51.576501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:51.578177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 603/1190] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:51 2022] GET /identity/v3/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:53:51.584081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:51.709760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe52de-1a55-46b7-9adc-ecfdd528d99b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:51.723926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:51.749577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff71b7-114c-446b-815e-4cef280b2970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:51.750422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff71b7-114c-446b-815e-4cef280b2970 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:51.750697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff71b7-114c-446b-815e-4cef280b2970 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:51.750965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff71b7-114c-446b-815e-4cef280b2970 None admin] PATH_INFO: `/v3/projects/9955a46c82704d04868e8ce62ac7be15` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:51.752219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff71b7-114c-446b-815e-4cef280b2970 None admin] RBAC: Authorizing `identity:get_project(project_id=9955a46c82704d04868e8ce62ac7be15)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:51.753677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff71b7-114c-446b-815e-4cef280b2970 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:51.755421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 588/1191] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:51 2022] GET /identity/v3/projects/9955a46c82704d04868e8ce62ac7be15 => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:51.761516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:51.861909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a396d-4298-4b9b-bb65-523d6e85d3d3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:51.897089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca35c-7d0c-4584-ad7b-9bee498686f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:51.897962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca35c-7d0c-4584-ad7b-9bee498686f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:51.898235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca35c-7d0c-4584-ad7b-9bee498686f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:51.898500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca35c-7d0c-4584-ad7b-9bee498686f3 None admin] PATH_INFO: `/v3/projects/9955a46c82704d04868e8ce62ac7be15/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:51.900758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca35c-7d0c-4584-ad7b-9bee498686f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9955a46c82704d04868e8ce62ac7be15, user_id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:51.902176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca35c-7d0c-4584-ad7b-9bee498686f3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:51.918916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 604/1192] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:53:51 2022] PUT /identity/v3/projects/9955a46c82704d04868e8ce62ac7be15/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:53:54.061077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81419868-9304-40d9-9806-f06eb3dfc7de None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:54.062015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81419868-9304-40d9-9806-f06eb3dfc7de None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:54.062015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81419868-9304-40d9-9806-f06eb3dfc7de None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:54.063991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 589/1193] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:53:54.069463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265888-2788-481e-a159-ed149bf52776 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:54.069875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265888-2788-481e-a159-ed149bf52776 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:54.069984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265888-2788-481e-a159-ed149bf52776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:54.087790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e8265888-2788-481e-a159-ed149bf52776 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:53:54.089066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e8265888-2788-481e-a159-ed149bf52776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:53:54.116903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:54.162199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 605/1194] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:53:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:53:54.186200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81419868-9304-40d9-9806-f06eb3dfc7de None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:54.307478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81419868-9304-40d9-9806-f06eb3dfc7de None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:54.341937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:54.342651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:54.342927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:54.343190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:54.354572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:53:54.362180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:53:54.363375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:53:54.364972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 590/1195] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:53:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:53:54.373085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265888-2788-481e-a159-ed149bf52776 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:54.485830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265888-2788-481e-a159-ed149bf52776 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:54.524379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:54.525073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:54.525357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:54.525627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:54.526373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:54.526678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:54.528055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:54.536861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 606/1196] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:54.543128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:54.590969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:54.652453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9840f1e-04b7-405f-9814-595f57a9288d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:54.688172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:54.689105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:54.689383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:54.689632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] PATH_INFO: `/v3/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:54.690857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] RBAC: Authorizing `identity:get_user(user_id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:54.692290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:54.693919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 591/1197] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 11:53:54 2022] GET /identity/v3/users/a7de3ed0f1e04d2e9ca1e82fcb80ebaf => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:54.702449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:54.734984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:54.816364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bba54d-925b-413e-af39-2164b72cdc2e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:54.852068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:54.852675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:54.852975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:54.853244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:54.921558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:54.922992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:54.948876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:55.022033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 607/1198] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:53:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:53:55.031823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:55.145551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab2c9a-e37f-42d5-b9b2-46aa7e204441 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:55.152663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:55.194743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74005d6-4fba-4a25-ba1c-95ca0c777be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:55.195648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74005d6-4fba-4a25-ba1c-95ca0c777be9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:55.195926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74005d6-4fba-4a25-ba1c-95ca0c777be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:55.196200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74005d6-4fba-4a25-ba1c-95ca0c777be9 None admin] PATH_INFO: `/v3/projects/9955a46c82704d04868e8ce62ac7be15` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:55.197422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74005d6-4fba-4a25-ba1c-95ca0c777be9 None admin] RBAC: Authorizing `identity:get_project(project_id=9955a46c82704d04868e8ce62ac7be15)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:55.198857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74005d6-4fba-4a25-ba1c-95ca0c777be9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:55.200580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 592/1199] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 11:53:55 2022] GET /identity/v3/projects/9955a46c82704d04868e8ce62ac7be15 => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:53:55.207686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:53:55.315206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e2cf-e734-4cf2-a383-d845ace78251 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:53:55.341632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:53:55.351359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6e29d-2e2d-48ef-b334-6937fbba5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:53:55.352007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6e29d-2e2d-48ef-b334-6937fbba5e42 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:53:55.352285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6e29d-2e2d-48ef-b334-6937fbba5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:53:55.352556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6e29d-2e2d-48ef-b334-6937fbba5e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:53:55.353427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6e29d-2e2d-48ef-b334-6937fbba5e42 None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=9955a46c82704d04868e8ce62ac7be15, user.id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:53:55.353738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6e29d-2e2d-48ef-b334-6937fbba5e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:53:55.355176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6e29d-2e2d-48ef-b334-6937fbba5e42 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:53:55.361774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 608/1200] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:53:55 2022] GET /identity/v3/role_assignments?user.id=a7de3ed0f1e04d2e9ca1e82fcb80ebaf&scope.project.id=9955a46c82704d04868e8ce62ac7be15&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:05.187693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:05.358482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.603974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf591-ee20-49a9-8b2e-f851f034017f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.604632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf591-ee20-49a9-8b2e-f851f034017f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.604632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf591-ee20-49a9-8b2e-f851f034017f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.606299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 593/1201] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:55.614307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33859df-ed21-4a59-9cfb-28a1cb4fd0ed None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.614784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33859df-ed21-4a59-9cfb-28a1cb4fd0ed None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.614872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33859df-ed21-4a59-9cfb-28a1cb4fd0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.635761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a33859df-ed21-4a59-9cfb-28a1cb4fd0ed None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:55.637773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a33859df-ed21-4a59-9cfb-28a1cb4fd0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:55.728795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 609/1202] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:54:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:54:55.757597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf591-ee20-49a9-8b2e-f851f034017f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.886032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf591-ee20-49a9-8b2e-f851f034017f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.926991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.927879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.928110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.928454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.942143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.943642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:54:55.962444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:55.963613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:55.964625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:54:55.964625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:54:55.964625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:55.964625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:54:55.964625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 594/1203] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:55.970079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33859df-ed21-4a59-9cfb-28a1cb4fd0ed None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.090693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33859df-ed21-4a59-9cfb-28a1cb4fd0ed None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.123598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.134285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78e20-78b7-4fb1-8ded-1c866bdd777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.135125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e20-78b7-4fb1-8ded-1c866bdd777b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.135486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e20-78b7-4fb1-8ded-1c866bdd777b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.135819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e20-78b7-4fb1-8ded-1c866bdd777b None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.136749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d78e20-78b7-4fb1-8ded-1c866bdd777b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:56.139831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d78e20-78b7-4fb1-8ded-1c866bdd777b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.141409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d78e20-78b7-4fb1-8ded-1c866bdd777b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.161480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 610/1204] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:56.163417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.230987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.297326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9422b-f441-437c-ac7b-a5bf34777251 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.345211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f5d3-f180-40a0-b0cb-036edad73bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.345878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f5d3-f180-40a0-b0cb-036edad73bd0 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.346143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f5d3-f180-40a0-b0cb-036edad73bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.346445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f5d3-f180-40a0-b0cb-036edad73bd0 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.347176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f5d3-f180-40a0-b0cb-036edad73bd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.348790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f5d3-f180-40a0-b0cb-036edad73bd0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.371348 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 595/1205] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 11:54:56 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:58.768385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4a60-33b6-4cea-b3d9-5687c548b05e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.768946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4a60-33b6-4cea-b3d9-5687c548b05e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.768946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4a60-33b6-4cea-b3d9-5687c548b05e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.770442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 611/1206] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:58.775992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059fe0-0443-4e30-a4f7-12d46f050863 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.776432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059fe0-0443-4e30-a4f7-12d46f050863 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.776531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059fe0-0443-4e30-a4f7-12d46f050863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.797717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ad059fe0-0443-4e30-a4f7-12d46f050863 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:58.798892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ad059fe0-0443-4e30-a4f7-12d46f050863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:58.868742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 596/1207] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:54:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:54:58.891924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4a60-33b6-4cea-b3d9-5687c548b05e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.003290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4a60-33b6-4cea-b3d9-5687c548b05e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.040052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.040810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.041091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.041394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.052686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:59.060512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:59.061616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:54:59.062483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:54:59.066760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 612/1208] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:54:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:59.068346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad059fe0-0443-4e30-a4f7-12d46f050863 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.112452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.182062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad059fe0-0443-4e30-a4f7-12d46f050863 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.221915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.222792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.223082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.223414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.224268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:59.224603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.226210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.236620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 597/1209] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:59.242116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.300142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.360690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7552-69f1-4ce8-9c82-12746f743b44 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.401018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.402454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.402454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.402454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.415798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.417349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:54:59.436723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:59.437706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:59.438616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:54:59.438616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:54:59.438616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:59.438616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:54:59.438616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 613/1210] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:59.443967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.558750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.562376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31dfc-5b2d-4f22-9450-9c1b68a107f8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.602098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.602791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.603059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.603343 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.604098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:59.604405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.605950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.619984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 598/1211] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:59.626038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.776782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7893c-49d2-4f3f-aaf4-ef28c6d46138 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.778987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.819217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.820183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.820563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.820980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.830025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.837780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:54:59.847085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:59.848246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:54:59.849447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 614/1212] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:59.854610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.966681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c46bb6-f843-4f4e-9bec-cd78b8f5b706 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.005709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.006561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.006843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.007117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.007956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:00.008263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.009731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.032372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 599/1213] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:00.041382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.164578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fdc1c-d113-413c-82ad-ab81cf20615a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.204378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.205199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.205482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.205744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.244534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.293308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.294996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.418416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 615/1214] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:55:00.424384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.445320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.532139 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66136-a78f-44a1-9840-32fc65264b77 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.570644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.571555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.571900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.572261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.583332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.584984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:00.602760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:00.603989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:00.605354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:00.605354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:00.605354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:00.605354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:00.605354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 600/1215] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:00.615891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.689513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.733950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746aecf1-5e35-4f87-aa8b-58769f69e46e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.772613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.773301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.773582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.773856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.774587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:00.774910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.776262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.788783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 616/1216] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:00.794550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.877756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.916950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d123d-0663-480d-a852-e21bd2326708 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.959527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.960241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.960508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.960800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.967819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.969287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:00.982895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:00.984321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:00.985471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 601/1217] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:00.990139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:01.093548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a0d5-dfc7-4ee4-9f34-3badef93bb21 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:01.119166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:01.132585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802da2b-72e4-4e04-a35f-ffe0c2ab5afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:01.133345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802da2b-72e4-4e04-a35f-ffe0c2ab5afc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:01.133621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802da2b-72e4-4e04-a35f-ffe0c2ab5afc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:01.133923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802da2b-72e4-4e04-a35f-ffe0c2ab5afc None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.134677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802da2b-72e4-4e04-a35f-ffe0c2ab5afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:01.134980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802da2b-72e4-4e04-a35f-ffe0c2ab5afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:01.136459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802da2b-72e4-4e04-a35f-ffe0c2ab5afc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:01.150207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 617/1218] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:01.156606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:01.270521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e6a9-ae65-41f6-85bb-16abd845f8f2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:01.301906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:01.311339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f68bf9-71fe-4e1b-80a4-98be3b79fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:01.312077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f68bf9-71fe-4e1b-80a4-98be3b79fe1c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:01.312388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f68bf9-71fe-4e1b-80a4-98be3b79fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:01.312695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f68bf9-71fe-4e1b-80a4-98be3b79fe1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.313568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f68bf9-71fe-4e1b-80a4-98be3b79fe1c None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=1f1c8f34e83d45c99e25f7fe3711e5da) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:01.313900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f68bf9-71fe-4e1b-80a4-98be3b79fe1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:01.315501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f68bf9-71fe-4e1b-80a4-98be3b79fe1c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:01.321995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 602/1219] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:55:01 2022] GET /identity/v3/role_assignments?user.id=1f1c8f34e83d45c99e25f7fe3711e5da&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:03.506755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087b479-366e-4f97-8f03-144e397bbcc0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.507172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087b479-366e-4f97-8f03-144e397bbcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.507305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087b479-366e-4f97-8f03-144e397bbcc0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.508879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 618/1220] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:03.514161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6676def-2bb8-4c32-91d0-7e8bbc4eaa82 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.514605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6676def-2bb8-4c32-91d0-7e8bbc4eaa82 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.514697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6676def-2bb8-4c32-91d0-7e8bbc4eaa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.532381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e6676def-2bb8-4c32-91d0-7e8bbc4eaa82 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:03.534102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e6676def-2bb8-4c32-91d0-7e8bbc4eaa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:03.608674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 603/1221] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:03.629359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087b479-366e-4f97-8f03-144e397bbcc0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.767494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087b479-366e-4f97-8f03-144e397bbcc0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.808077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.809171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.809457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.809732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.821684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:03.829521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:03.830695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:03.831727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 619/1222] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:55:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:03.836947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6676def-2bb8-4c32-91d0-7e8bbc4eaa82 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.944301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6676def-2bb8-4c32-91d0-7e8bbc4eaa82 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.972885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:03.985975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.986811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.987103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.987372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.988305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:03.988605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.990170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.999068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 604/1223] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:04.004912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.055594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.117661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b610ad-ced0-436f-870f-36d86a9eb8e4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.156494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.157498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.157830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.158245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.171078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.172867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:04.190445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:04.191489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:04.192673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:04.192673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:04.192673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:04.192673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:04.192673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 620/1224] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:04.198314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.315959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96709f2-f3c8-43ce-814f-91ae2979e306 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.355793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.356523 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.356878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.357179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.358071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:04.358378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.359918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.372987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 605/1225] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:04.378883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.483862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.491520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ded8-2d97-4d6e-aafb-f0938c4b5e2f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.532437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.533407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.533687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.533958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.541259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.542745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:04.557703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:04.558944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:04.559966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 621/1226] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:04.564942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.613754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.681603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6e53c-ca2c-4107-928d-c915e93a7f7a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.718294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.718963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.719237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.719503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.720332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:04.720632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.722102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.746599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 606/1227] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:04.747949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.853455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf9f73-4fb1-44df-983a-6a0ec06e8247 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.893210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.893990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.894268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.894667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.907166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.908895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:04.930287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:04.931299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:04.932271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:04.932271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:04.932271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:04.932271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:04.932271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 622/1228] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:04.938152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.044582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369033-489a-42bd-ac7a-55f49ad0e7e9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.047094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.081722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.082480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.082760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.083030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.083751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:05.084057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.085588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.097401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 607/1229] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:05.103267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.114828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.214927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171ce4-0bae-4a4b-b380-a1f964880a3b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.258148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.259139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.259423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.259696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.267881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.269686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:05.286682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:05.287797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:05.293526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 623/1230] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:05.294307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.402692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c692d3-0033-4540-ad5f-8245824f2fe1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.437356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6255-e500-4b5a-a068-dbb3b450b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.438047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6255-e500-4b5a-a068-dbb3b450b324 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.438327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6255-e500-4b5a-a068-dbb3b450b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.438599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6255-e500-4b5a-a068-dbb3b450b324 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.439394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6255-e500-4b5a-a068-dbb3b450b324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:05.439737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6255-e500-4b5a-a068-dbb3b450b324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.441190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6255-e500-4b5a-a068-dbb3b450b324 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.453773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 608/1231] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:05.460010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.532059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.567535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55174c-4201-4125-b814-53104c6bd9c0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.601056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03629c-45b2-46a0-a907-3f2c42ee44fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.601941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03629c-45b2-46a0-a907-3f2c42ee44fd None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.602214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03629c-45b2-46a0-a907-3f2c42ee44fd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.602480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03629c-45b2-46a0-a907-3f2c42ee44fd None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/1f1c8f34e83d45c99e25f7fe3711e5da/roles/7e8c2c66c0d84397b4dec3d68ef8105c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.617179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03629c-45b2-46a0-a907-3f2c42ee44fd None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=1f1c8f34e83d45c99e25f7fe3711e5da, role_id=7e8c2c66c0d84397b4dec3d68ef8105c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.618632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03629c-45b2-46a0-a907-3f2c42ee44fd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.631079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 624/1232] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:55:05 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/1f1c8f34e83d45c99e25f7fe3711e5da/roles/7e8c2c66c0d84397b4dec3d68ef8105c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:55:07.819008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcba65-b4bc-42b2-a92e-0ba0ff7f81aa None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.819629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcba65-b4bc-42b2-a92e-0ba0ff7f81aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.819629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcba65-b4bc-42b2-a92e-0ba0ff7f81aa None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.820982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 609/1233] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:07.826580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ba7f1-56dc-4cf8-bdac-c52831476ae9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.827030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ba7f1-56dc-4cf8-bdac-c52831476ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.827183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ba7f1-56dc-4cf8-bdac-c52831476ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.845663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ae1ba7f1-56dc-4cf8-bdac-c52831476ae9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:07.847054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ae1ba7f1-56dc-4cf8-bdac-c52831476ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:07.918186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 625/1234] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:07.941569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcba65-b4bc-42b2-a92e-0ba0ff7f81aa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.970957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.053612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcba65-b4bc-42b2-a92e-0ba0ff7f81aa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.091864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.092661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.092954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.093295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.104793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:08.112511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:08.113742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:08.117924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 610/1235] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:08.119902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ba7f1-56dc-4cf8-bdac-c52831476ae9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.168296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.225008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ba7f1-56dc-4cf8-bdac-c52831476ae9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.267079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.267806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.268137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.268357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.269141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:08.269455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.270939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.288160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 626/1236] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:08.289437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.379249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.398070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2dcc3-cc73-4197-afcf-b96d327ff30d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.433205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.433997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.434275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.434541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.445951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.447403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:08.467200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:08.468284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:08.469243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:08.469243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:08.469243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:08.469243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:08.469243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 611/1237] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:08.474634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.585973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405841f0-d44b-4c65-8bd1-a247a01513e2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.594986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.621617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.622212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.622492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.622820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.623531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:08.623836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.625280 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.637406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 627/1238] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:08.643360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.753887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7cb9e-e953-4d36-9588-357c93f19dc9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.791623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.792444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.792757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.793052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.795747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.801869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.803281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:08.818101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:08.819732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:08.820864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:08.824348 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 612/1239] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:08.825585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.932178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416ff0-8735-48c4-b80f-d70d47fe6a7b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.966187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.966839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.967173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.967366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.968201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:08.968501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.970034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.987661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 628/1240] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:08.993613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:09.105647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf43ffa-73b6-4122-8631-a759741bf57d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:09.157232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:09.157918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:09.158205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:09.158476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:09.227116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:09.235394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:09.236930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:09.347472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 613/1241] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:55:09.353323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:09.381457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:09.458721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3a200-5542-4b6b-b2c7-595bc00354c9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:09.495376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:09.496166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:09.496483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:09.496836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:09.509033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:09.510508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:09.530198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:09.531335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:09.532834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:09.532834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:09.532834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:09.532834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:09.532834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 629/1242] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:09.537518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:09.643987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:09.651153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566a957-4842-4afa-af5e-1464abcc5875 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:09.690526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:09.691260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:09.691534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:09.691803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:09.692611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:09.693036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:09.694668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:09.706799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 614/1243] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:09.712528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:09.797168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:09.819569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac377b51-ec71-49cd-825f-26472384bade None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:09.857819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:09.858665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:09.858985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:09.859245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:09.866630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:09.868218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:09.884568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:09.885821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:09.886931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 630/1244] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:09.892072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:09.996929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedeef0-6e09-4f58-92a7-3f60701a9dd2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.034482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e9d3c-f79f-40ce-8b6f-8804a3f193d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.035161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e9d3c-f79f-40ce-8b6f-8804a3f193d5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.035424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e9d3c-f79f-40ce-8b6f-8804a3f193d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.035741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e9d3c-f79f-40ce-8b6f-8804a3f193d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.036529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e9d3c-f79f-40ce-8b6f-8804a3f193d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:10.036871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e9d3c-f79f-40ce-8b6f-8804a3f193d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.038344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e9d3c-f79f-40ce-8b6f-8804a3f193d5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.051732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 615/1245] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:10.058009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.163646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ba2c-f03f-4878-a60c-e582b2b33b23 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.198345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc7d5c-4ccb-41d9-a384-c3ab2bdd027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.199065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc7d5c-4ccb-41d9-a384-c3ab2bdd027b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.199369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc7d5c-4ccb-41d9-a384-c3ab2bdd027b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.199617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc7d5c-4ccb-41d9-a384-c3ab2bdd027b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.200536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc7d5c-4ccb-41d9-a384-c3ab2bdd027b None admin] RBAC: Adding query filter params (role.id=7e8c2c66c0d84397b4dec3d68ef8105c, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=1f1c8f34e83d45c99e25f7fe3711e5da) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:10.200867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc7d5c-4ccb-41d9-a384-c3ab2bdd027b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.202301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc7d5c-4ccb-41d9-a384-c3ab2bdd027b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.208463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 631/1246] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/role_assignments?user.id=1f1c8f34e83d45c99e25f7fe3711e5da&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=7e8c2c66c0d84397b4dec3d68ef8105c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:12.738852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0b3a2-2b62-4715-94c4-706566dbef86 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:12.739451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0b3a2-2b62-4715-94c4-706566dbef86 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:12.739451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0b3a2-2b62-4715-94c4-706566dbef86 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:12.740825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 616/1247] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:12.753460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79117e0b-21da-45dc-8a4c-44d48fad2c77 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:12.754290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79117e0b-21da-45dc-8a4c-44d48fad2c77 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:12.754290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79117e0b-21da-45dc-8a4c-44d48fad2c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:12.759935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:12.774321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-79117e0b-21da-45dc-8a4c-44d48fad2c77 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:12.775587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79117e0b-21da-45dc-8a4c-44d48fad2c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:12.851619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 632/1248] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:55:12.877470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0b3a2-2b62-4715-94c4-706566dbef86 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:12.897532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:12.992773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0b3a2-2b62-4715-94c4-706566dbef86 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.032744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.033578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.033855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.034121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.046206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:13.054679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:13.055919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:13.056868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 617/1249] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:55:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:13.062663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79117e0b-21da-45dc-8a4c-44d48fad2c77 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.171178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79117e0b-21da-45dc-8a4c-44d48fad2c77 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.200851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.207671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.208435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.208803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.209173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.210115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:13.210510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.212233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.227330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 633/1250] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:13.228971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.319959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.346493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2f8bb-fa2c-4266-81e3-74a6054b7a05 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.381982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.382767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.383046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.383315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.394364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.395814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:13.414609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:13.415753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:13.418082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:13.418082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:13.418082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:13.418082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:13.418082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 618/1251] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:13.422747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.551149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee777-92ca-4d5a-ab03-33c16ca7dfb1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.590908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.591568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.591839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.592178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.593037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:13.593378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.595071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.608336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 634/1252] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:13.614158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.736736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86ff4e-ef40-4686-8cd4-26c13da72218 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.767034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.776219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.777037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.777319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.777990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.786169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.787821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:13.805156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:13.807037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:13.809167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 619/1253] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:13.814242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.882924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.935975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7309c9-ccaa-4ba1-abe3-a5d81af8a163 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.974550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.975258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.975575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.975938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.977217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:13.977621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.979487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.002106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 635/1254] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:14.005089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:14.114660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b658-15a5-4b3c-b8e2-2ac436c0db4f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:14.153651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.154276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.154552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.154826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.219119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:14.232778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.234207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.346550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 620/1255] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:55:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:55:14.352895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:14.474045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118a58-637c-4447-96ea-5e41d1e6f265 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:14.492380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:14.525093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.525916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.526158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.526510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.539040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.540624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:14.559893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:14.561008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:14.562011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:14.562011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:14.562011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:14.562011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:14.562011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 636/1256] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:14.567223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:14.674448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:14.683911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd8d1-6b6a-4ff7-b586-26d5f8fdc645 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:14.719493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.720222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.720509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.721018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.721917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:14.722242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.723700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.742979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 621/1257] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:14.744205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:14.858432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92865e-a09b-4122-95ec-5b8be4fae563 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:14.898670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.899804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.901667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.901667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.909687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.910685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:14.926348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:14.927485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:14.929015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 637/1258] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:14.934600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:15.052206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304e50-ddeb-42dc-be22-5d8309c0deb8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:15.093857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aff2e-d54f-49bc-bbf3-3f81a6bbcaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:15.094532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aff2e-d54f-49bc-bbf3-3f81a6bbcaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:15.094967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aff2e-d54f-49bc-bbf3-3f81a6bbcaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:15.095216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aff2e-d54f-49bc-bbf3-3f81a6bbcaf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:15.096112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aff2e-d54f-49bc-bbf3-3f81a6bbcaf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:15.096490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aff2e-d54f-49bc-bbf3-3f81a6bbcaf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:15.098105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aff2e-d54f-49bc-bbf3-3f81a6bbcaf6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:15.111774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 622/1259] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:55:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:15.118549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:15.145265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:15.238198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043e54c-ef49-4e5c-93a1-09f4ee41e49e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:15.281092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a593607-a38b-406d-b97b-1587c51dfd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:15.281760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593607-a38b-406d-b97b-1587c51dfd4b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:15.282026 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593607-a38b-406d-b97b-1587c51dfd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:15.282295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593607-a38b-406d-b97b-1587c51dfd4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:15.283125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593607-a38b-406d-b97b-1587c51dfd4b None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=1f1c8f34e83d45c99e25f7fe3711e5da) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:15.283435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593607-a38b-406d-b97b-1587c51dfd4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:15.285189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593607-a38b-406d-b97b-1587c51dfd4b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:15.292004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 638/1260] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:55:15 2022] GET /identity/v3/role_assignments?user.id=1f1c8f34e83d45c99e25f7fe3711e5da&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=aafa433396f14143bb549af1f2b6219b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:17.498900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99a6dd-f5a6-4f82-885f-08854a06569d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.499444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99a6dd-f5a6-4f82-885f-08854a06569d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.499444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99a6dd-f5a6-4f82-885f-08854a06569d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.502879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 623/1261] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:17.507553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78095-8e32-4261-af6c-baa44b5f9ec0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.508234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78095-8e32-4261-af6c-baa44b5f9ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.508408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78095-8e32-4261-af6c-baa44b5f9ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.527083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-04f78095-8e32-4261-af6c-baa44b5f9ec0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:17.528604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-04f78095-8e32-4261-af6c-baa44b5f9ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:17.597347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 639/1262] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:17.620590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99a6dd-f5a6-4f82-885f-08854a06569d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:17.636947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:17.731546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99a6dd-f5a6-4f82-885f-08854a06569d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:17.767672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:17.768383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.768677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.768943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.781971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:17.789499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:17.790637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:17.791557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 624/1263] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:17.797747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f78095-8e32-4261-af6c-baa44b5f9ec0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:17.819794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:17.915547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f78095-8e32-4261-af6c-baa44b5f9ec0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:17.959296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:17.959966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.960246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.960516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.961291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:17.961595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:17.962982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:17.971855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 640/1264] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:17.978728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.063452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.103400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e4432-d64d-4f68-9082-6a08f3119a39 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.149722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.150932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.151332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.151748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.168734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.170181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:18.189353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:18.191361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:18.193162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:18.193162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:18.193162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:18.193162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:18.193162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 625/1265] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:18.199194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.318093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.346388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6a7c3-ca56-433d-9b20-9a0e6488ebc5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.383772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.384416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.384683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.385092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.385810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:18.386113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.387480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.401971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 641/1266] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.411000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.524007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767b30-0fcf-4a87-9365-40917d8fe5de None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.545995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.562296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.563088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.563359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.563618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.571644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.573200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:18.587710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:18.588896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:18.590280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 626/1267] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:18.596406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.698710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d6c7-5942-4c60-b9b7-488ee978aae4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.733988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.734694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.734971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.735240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.736075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:18.736378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.737846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.747413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.760757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 642/1268] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.766596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.866094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3414c9-a3e8-40b7-99a7-f6bfa8c1b320 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.903519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.904721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.905204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.905627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.921039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.922497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:18.939767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:18.940844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:18.942143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:18.942143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:18.942143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:18.942143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:18.942143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 627/1269] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:18.946778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.050480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbdfb0-d1ee-41a5-9da5-6c20ee492261 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.089810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.090451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.090727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.090997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.091714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:19.092021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.093415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.105886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 643/1270] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:19.112393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.164182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.241306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd729a-92c8-468b-b81e-68f1848c03f7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.279515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.280286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.280563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.280861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.287960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.289427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:19.304011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:19.305166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:19.306467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 628/1271] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:19.312975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.380539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.436882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6415c-def6-4fd1-969f-4f99a8561860 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.477382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b261f9f-b098-4fb8-98dd-366a114c9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.478031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261f9f-b098-4fb8-98dd-366a114c9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.478305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261f9f-b098-4fb8-98dd-366a114c9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.478575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261f9f-b098-4fb8-98dd-366a114c9fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.479386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b261f9f-b098-4fb8-98dd-366a114c9fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:19.479689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b261f9f-b098-4fb8-98dd-366a114c9fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.481175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b261f9f-b098-4fb8-98dd-366a114c9fe9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.494114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 644/1272] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:19.501434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.608501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.619461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180b5ad-4f25-445e-9fa9-df301153125f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.655984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479179a-f28c-4473-ab7b-c3a70a0cd21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.656881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479179a-f28c-4473-ab7b-c3a70a0cd21c None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.657154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479179a-f28c-4473-ab7b-c3a70a0cd21c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.657422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479179a-f28c-4473-ab7b-c3a70a0cd21c None admin] PATH_INFO: `/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/1f1c8f34e83d45c99e25f7fe3711e5da/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.659366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479179a-f28c-4473-ab7b-c3a70a0cd21c None admin] RBAC: Authorizing `identity:create_grant(project_id=5661cb1278b34280b8cd68754b5b1bfd, user_id=1f1c8f34e83d45c99e25f7fe3711e5da, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.660821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479179a-f28c-4473-ab7b-c3a70a0cd21c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.676171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 629/1273] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 11:55:19 2022] PUT /identity/v3/projects/5661cb1278b34280b8cd68754b5b1bfd/users/1f1c8f34e83d45c99e25f7fe3711e5da/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:21.816791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0884cb-b992-4257-97f4-d0f5a3a86ce0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.817689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0884cb-b992-4257-97f4-d0f5a3a86ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.817689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0884cb-b992-4257-97f4-d0f5a3a86ce0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.819914 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 645/1274] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:21.825287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe286-cc94-4852-9456-edd336263a7e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.825731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe286-cc94-4852-9456-edd336263a7e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.825820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe286-cc94-4852-9456-edd336263a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.844136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-171fe286-cc94-4852-9456-edd336263a7e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:21.845324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-171fe286-cc94-4852-9456-edd336263a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:21.914105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 630/1275] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:21.937092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0884cb-b992-4257-97f4-d0f5a3a86ce0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.043114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0884cb-b992-4257-97f4-d0f5a3a86ce0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.060332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:22.079569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.080277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.080552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.080854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.092110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:22.099578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:22.100710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:22.101894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 646/1276] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 11:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:22.107353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe286-cc94-4852-9456-edd336263a7e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.204770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:22.226388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe286-cc94-4852-9456-edd336263a7e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.262989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.263658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.263922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.264185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.264950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:22.265247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.266615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.275177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 631/1277] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 11:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:22.281828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.384140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f416-4b57-448e-b97c-4fed2fd952ab None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.417068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.417842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.418121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.418387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.429463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.430930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:22.448305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:22.449342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:22.450351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:22.450351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:22.450351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:22.450351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:22.450351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 647/1278] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:22.456182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.568627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f220d2-cffd-499d-89e3-33814e0682e4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.608090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.608760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.609040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.609311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.610027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:22.610329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.611693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.623971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 632/1279] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:22.630634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.668691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:22.741953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c6bc3-7b1c-4bb2-8725-d3ea49bbb7c5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.776278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.777404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.777684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.777956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.786060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.787510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:22.801999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:22.803060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:22.804868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 648/1280] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:22.812337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.818606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:22.922067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903318e-0466-462a-9db2-c135731e8ad1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.958195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.958855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.959135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.959407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.960245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:22.960554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.962014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.979306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 633/1281] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 11:55:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:22.985267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:23.081982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:23.092462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e682-e32b-488a-acc8-41854de3da88 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:23.129670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:23.130304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.130575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.130840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.198928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:23.200311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:23.304432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:23.315575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 649/1282] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 11:55:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:55:23.324632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:23.397455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:23.438822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4872e-efb9-41e2-829b-5feb3105d76f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:23.474225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:23.474930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.475208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.475480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.485843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:23.487310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:23.507027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:23.508053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:23.509405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:23.509405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:23.509405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:23.509405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:23.509405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 634/1283] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:23.514067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:23.613848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c376a23-f8b4-4364-940a-076ea2d0b99c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:23.646560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:23.647214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.647492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.647766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.648482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:23.648819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:23.650222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:23.667409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 650/1284] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 11:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:23.673415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:23.788719 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545ae14-2cf0-4dad-b664-08f1a0db059d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:23.803490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:23.825224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:23.826001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.826278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.826550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.833628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:23.835069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:23.849110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:23.850115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application May 19 11:55:23.851350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 635/1285] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 11:55:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:23.856874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:23.911554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:23.966298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8b2f6-5149-41e1-a824-95500ffbdad9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.002550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53ec29-4b5a-4561-8a21-c0c04de0cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.003165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ec29-4b5a-4561-8a21-c0c04de0cc50 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.003475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ec29-4b5a-4561-8a21-c0c04de0cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.003749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ec29-4b5a-4561-8a21-c0c04de0cc50 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.004531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53ec29-4b5a-4561-8a21-c0c04de0cc50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:24.004867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53ec29-4b5a-4561-8a21-c0c04de0cc50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.006306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53ec29-4b5a-4561-8a21-c0c04de0cc50 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.019454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 651/1286] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 11:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.025857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.130042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7158a-fecc-4aa3-bebc-cc7d8e656fea None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.165411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe64b3-680f-4212-9157-2bffe3d519de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.166098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe64b3-680f-4212-9157-2bffe3d519de None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.166376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe64b3-680f-4212-9157-2bffe3d519de None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.166649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe64b3-680f-4212-9157-2bffe3d519de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.167457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe64b3-680f-4212-9157-2bffe3d519de None admin] RBAC: Adding query filter params (role.id=aafa433396f14143bb549af1f2b6219b, scope.project.id=5661cb1278b34280b8cd68754b5b1bfd, user.id=1f1c8f34e83d45c99e25f7fe3711e5da) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:24.167765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe64b3-680f-4212-9157-2bffe3d519de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.169236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe64b3-680f-4212-9157-2bffe3d519de None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.175205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 636/1287] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/role_assignments?user.id=1f1c8f34e83d45c99e25f7fe3711e5da&scope.project.id=5661cb1278b34280b8cd68754b5b1bfd&role.id=aafa433396f14143bb549af1f2b6219b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:26.394297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a770-cdda-48b2-b34f-29ade5701e6b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.394829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a770-cdda-48b2-b34f-29ade5701e6b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.394829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a770-cdda-48b2-b34f-29ade5701e6b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.396222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 652/1288] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:26.402220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e35f7-6ac6-4e99-8dae-47a28d62667b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.402621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e35f7-6ac6-4e99-8dae-47a28d62667b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.402766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e35f7-6ac6-4e99-8dae-47a28d62667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.420389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8d4e35f7-6ac6-4e99-8dae-47a28d62667b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:26.421613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8d4e35f7-6ac6-4e99-8dae-47a28d62667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:26.451527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:26.489245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 637/1289] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:26.511344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3a770-cdda-48b2-b34f-29ade5701e6b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:26.626952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3a770-cdda-48b2-b34f-29ade5701e6b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:26.639716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:26.674337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:26.675061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.675335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.675597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.676244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:26.677637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:26.689326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:26.690508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:26.691564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 653/1290] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:55:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:26.696936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e35f7-6ac6-4e99-8dae-47a28d62667b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:26.804385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e35f7-6ac6-4e99-8dae-47a28d62667b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:26.839848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad2728-b079-469a-94b5-c3a4bc77fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:26.840493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad2728-b079-469a-94b5-c3a4bc77fc34 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.840810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad2728-b079-469a-94b5-c3a4bc77fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.841084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad2728-b079-469a-94b5-c3a4bc77fc34 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.841788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad2728-b079-469a-94b5-c3a4bc77fc34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:26.842095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad2728-b079-469a-94b5-c3a4bc77fc34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:26.843469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad2728-b079-469a-94b5-c3a4bc77fc34 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:26.848561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 638/1291] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 11:55:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:26.855198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:26.971947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f90ab6-69b5-4bde-a46a-0fd5e6c727f2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:27.008728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1752ee-4808-4afe-a9f3-f7336a057ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:27.009376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1752ee-4808-4afe-a9f3-f7336a057ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:27.009653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1752ee-4808-4afe-a9f3-f7336a057ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:27.009925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1752ee-4808-4afe-a9f3-f7336a057ae0 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:27.010634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1752ee-4808-4afe-a9f3-f7336a057ae0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:27.010937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1752ee-4808-4afe-a9f3-f7336a057ae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:27.012332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1752ee-4808-4afe-a9f3-f7336a057ae0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:27.017169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 654/1292] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 11:55:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.197620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c54c46-63e2-46ad-b379-708bdfd0d4db None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.198471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c54c46-63e2-46ad-b379-708bdfd0d4db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.198471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c54c46-63e2-46ad-b379-708bdfd0d4db None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.200692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 639/1293] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:29.206992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef5994-d651-4f2c-81b6-d0412010d37c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.207444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef5994-d651-4f2c-81b6-d0412010d37c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.207675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef5994-d651-4f2c-81b6-d0412010d37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.228038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-30ef5994-d651-4f2c-81b6-d0412010d37c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:29.229247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30ef5994-d651-4f2c-81b6-d0412010d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:29.260827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.300624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 655/1294] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:29.323351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c54c46-63e2-46ad-b379-708bdfd0d4db None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.364295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.446983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c54c46-63e2-46ad-b379-708bdfd0d4db None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.490625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff42b3-5c37-4e0e-a6f8-94805bbe5086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.491193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff42b3-5c37-4e0e-a6f8-94805bbe5086 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.491466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff42b3-5c37-4e0e-a6f8-94805bbe5086 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.491732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff42b3-5c37-4e0e-a6f8-94805bbe5086 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.492472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff42b3-5c37-4e0e-a6f8-94805bbe5086 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.493866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff42b3-5c37-4e0e-a6f8-94805bbe5086 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.510083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 640/1295] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 11:55:29 2022] POST /identity/v3/services => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:31.719840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fd8f6-824f-461e-aecf-9ab4eab41daf None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:31.720432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fd8f6-824f-461e-aecf-9ab4eab41daf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:31.720432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fd8f6-824f-461e-aecf-9ab4eab41daf None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:31.721829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 656/1296] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:31.728220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0a00-a3d9-4291-b593-16fe3c1f14c9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:31.728983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0a00-a3d9-4291-b593-16fe3c1f14c9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:31.729142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0a00-a3d9-4291-b593-16fe3c1f14c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:31.757827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-667c0a00-a3d9-4291-b593-16fe3c1f14c9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:31.759491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-667c0a00-a3d9-4291-b593-16fe3c1f14c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:31.846947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 641/1297] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:31.869766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fd8f6-824f-461e-aecf-9ab4eab41daf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:31.982793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fd8f6-824f-461e-aecf-9ab4eab41daf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:32.023888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:32.024685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:32.024985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:32.025261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:32.025911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:32.027609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:32.041515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:32.042792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:32.044476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 657/1298] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:55:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:32.056066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0a00-a3d9-4291-b593-16fe3c1f14c9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:32.076500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:32.159510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0a00-a3d9-4291-b593-16fe3c1f14c9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:32.195328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:32.195970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:32.196243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:32.196536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:32.197267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:32.197563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:32.198922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:32.204171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 642/1299] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 11:55:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:32.210755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:32.246247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:32.318269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e4743-8917-41c6-bfad-ce1a231fe350 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:32.355896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c23c36-6668-4b7c-a399-911bbfc09d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:32.356536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23c36-6668-4b7c-a399-911bbfc09d25 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:32.356840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23c36-6668-4b7c-a399-911bbfc09d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:32.357112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23c36-6668-4b7c-a399-911bbfc09d25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:32.357897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c23c36-6668-4b7c-a399-911bbfc09d25 None admin] RBAC: Adding query filter params (interface=public, service_id=c1289bfcbfb54230b274d89fdbd125b0, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:32.358204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c23c36-6668-4b7c-a399-911bbfc09d25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:32.359684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c23c36-6668-4b7c-a399-911bbfc09d25 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:32.364913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 658/1300] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 11:55:32 2022] GET /identity/v3/endpoints?service_id=c1289bfcbfb54230b274d89fdbd125b0&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:32.374494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:32.462389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:32.481262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2324-6428-43fb-994c-f4625d714c25 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:32.516377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64721b2-b8f3-4857-8dc8-315b7fa19150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:32.517063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64721b2-b8f3-4857-8dc8-315b7fa19150 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:32.517340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64721b2-b8f3-4857-8dc8-315b7fa19150 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:32.517603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64721b2-b8f3-4857-8dc8-315b7fa19150 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:32.518276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64721b2-b8f3-4857-8dc8-315b7fa19150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:32.519630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64721b2-b8f3-4857-8dc8-315b7fa19150 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:32.526884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 643/1301] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 11:55:32 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:55:34.685232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c52c9-b2ff-4b8d-823b-70d829910996 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.685937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c52c9-b2ff-4b8d-823b-70d829910996 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.685937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c52c9-b2ff-4b8d-823b-70d829910996 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.687596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 659/1302] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:55:34.695925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c040c-1b69-4af6-ad62-3a54110e76ce None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.696664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c040c-1b69-4af6-ad62-3a54110e76ce None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.696664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c040c-1b69-4af6-ad62-3a54110e76ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.721789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3b8c040c-1b69-4af6-ad62-3a54110e76ce None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:34.723602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3b8c040c-1b69-4af6-ad62-3a54110e76ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:34.796821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 644/1303] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:55:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:55:34.818917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c52c9-b2ff-4b8d-823b-70d829910996 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.925906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.933354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c52c9-b2ff-4b8d-823b-70d829910996 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.966670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.967459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.967739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.968003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.968662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.970061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:34.981764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:34.982867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 11:55:34.983774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 660/1304] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 11:55:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:34.989173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c040c-1b69-4af6-ad62-3a54110e76ce None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:35.066380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:35.089414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c040c-1b69-4af6-ad62-3a54110e76ce None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:35.124276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38615b37-02ac-466e-b93a-a0db10b10e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:35.124973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615b37-02ac-466e-b93a-a0db10b10e0f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:35.125248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615b37-02ac-466e-b93a-a0db10b10e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:35.125512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615b37-02ac-466e-b93a-a0db10b10e0f None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:35.126516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615b37-02ac-466e-b93a-a0db10b10e0f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:35.126817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615b37-02ac-466e-b93a-a0db10b10e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:35.128183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615b37-02ac-466e-b93a-a0db10b10e0f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:35.133558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 645/1305] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 11:55:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:35.139604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:35.260967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27824e3c-c5ab-4557-be33-fa7fd2f8ff8e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:35.298568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0fdc7-8c08-4d5a-8851-37fbbf9d8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:35.299217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0fdc7-8c08-4d5a-8851-37fbbf9d8ea1 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:35.299500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0fdc7-8c08-4d5a-8851-37fbbf9d8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:35.299768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0fdc7-8c08-4d5a-8851-37fbbf9d8ea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:35.300504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0fdc7-8c08-4d5a-8851-37fbbf9d8ea1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:35.301914 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0fdc7-8c08-4d5a-8851-37fbbf9d8ea1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:35.324249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 661/1306] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 11:55:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:45.130370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=30 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.319360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.075573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cde5fa-87bd-451d-abdd-1d31a6e1ae55 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.076059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cde5fa-87bd-451d-abdd-1d31a6e1ae55 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.076158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cde5fa-87bd-451d-abdd-1d31a6e1ae55 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.077568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 646/1307] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:39.083363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a5d0-0e53-48b7-b715-1245f498994e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.083363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a5d0-0e53-48b7-b715-1245f498994e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.084009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a5d0-0e53-48b7-b715-1245f498994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.177362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9192a5d0-0e53-48b7-b715-1245f498994e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:39.178675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9192a5d0-0e53-48b7-b715-1245f498994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:39.281915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 662/1308] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:39.332754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee6435-ca2b-4b27-b17d-96bcb7bbdd3b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.332975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee6435-ca2b-4b27-b17d-96bcb7bbdd3b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.333300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee6435-ca2b-4b27-b17d-96bcb7bbdd3b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.335360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 647/1309] 10.222.0.35 () {54 vars in 964 bytes} [Thu May 19 11:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:39.345595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a51e2-2938-4d17-a838-4a8927ce5e7d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.346549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a51e2-2938-4d17-a838-4a8927ce5e7d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.346949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a51e2-2938-4d17-a838-4a8927ce5e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.429707 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9b5a51e2-2938-4d17-a838-4a8927ce5e7d None None] MFA Rules not processed for user `9bb4c7ed74924ac4ad8f759437891569`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:39.430998 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9b5a51e2-2938-4d17-a838-4a8927ce5e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:39.453863 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.514430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 663/1310] 10.222.0.35 () {58 vars in 1061 bytes} [Thu May 19 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:39.523678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee6435-ca2b-4b27-b17d-96bcb7bbdd3b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.525674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-abee6435-ca2b-4b27-b17d-96bcb7bbdd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:39.646507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee6435-ca2b-4b27-b17d-96bcb7bbdd3b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:39.728279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc98fe6-46a4-48f5-8b17-2cd789a23d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:39.728973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98fe6-46a4-48f5-8b17-2cd789a23d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.729253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98fe6-46a4-48f5-8b17-2cd789a23d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.729525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98fe6-46a4-48f5-8b17-2cd789a23d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.731216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6fc98fe6-46a4-48f5-8b17-2cd789a23d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:39.796221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.858995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc98fe6-46a4-48f5-8b17-2cd789a23d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:39.860940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc98fe6-46a4-48f5-8b17-2cd789a23d4d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:39.880552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 648/1311] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:56:42.343112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ba1e5-5bcd-4acc-9a70-5188b617c15a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.343619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ba1e5-5bcd-4acc-9a70-5188b617c15a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.343704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ba1e5-5bcd-4acc-9a70-5188b617c15a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.349006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 664/1312] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:56:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:42.350738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9117b9-a66a-4ba0-a0b3-4e9610cea6b3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.351165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9117b9-a66a-4ba0-a0b3-4e9610cea6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.351380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9117b9-a66a-4ba0-a0b3-4e9610cea6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.436852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4f9117b9-a66a-4ba0-a0b3-4e9610cea6b3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:42.438451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4f9117b9-a66a-4ba0-a0b3-4e9610cea6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:42.550535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 649/1313] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:42.598849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7af32-f366-4007-aa08-c4e0fe2cb171 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.599096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7af32-f366-4007-aa08-c4e0fe2cb171 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.599623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7af32-f366-4007-aa08-c4e0fe2cb171 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.601143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 665/1314] 10.222.0.35 () {54 vars in 964 bytes} [Thu May 19 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:42.607040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721d75d-02b5-4f64-a3ad-a2ed3d68d4ea None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.607329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721d75d-02b5-4f64-a3ad-a2ed3d68d4ea None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.607602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721d75d-02b5-4f64-a3ad-a2ed3d68d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.618382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.686788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f721d75d-02b5-4f64-a3ad-a2ed3d68d4ea None None] MFA Rules not processed for user `9bb4c7ed74924ac4ad8f759437891569`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:42.688023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f721d75d-02b5-4f64-a3ad-a2ed3d68d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:42.773031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 650/1315] 10.222.0.35 () {58 vars in 1061 bytes} [Thu May 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:42.781897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7af32-f366-4007-aa08-c4e0fe2cb171 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.783447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e1d7af32-f366-4007-aa08-c4e0fe2cb171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:42.896314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7af32-f366-4007-aa08-c4e0fe2cb171 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.973167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.977039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a672b-72c0-4348-95a3-442612209be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.977629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a672b-72c0-4348-95a3-442612209be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.977907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a672b-72c0-4348-95a3-442612209be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.978384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a672b-72c0-4348-95a3-442612209be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.980685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-352a672b-72c0-4348-95a3-442612209be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:43.102480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a672b-72c0-4348-95a3-442612209be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.104147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a672b-72c0-4348-95a3-442612209be4 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.125480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 666/1316] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:56:45.893416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335d4da-ec51-49f7-af11-94f0676572b8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.894264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335d4da-ec51-49f7-af11-94f0676572b8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.894264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335d4da-ec51-49f7-af11-94f0676572b8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.896497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 651/1317] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:56:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:45.905455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295b6e-02e8-442a-8458-e11a7c9da9be None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.905871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295b6e-02e8-442a-8458-e11a7c9da9be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.906047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295b6e-02e8-442a-8458-e11a7c9da9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.975674 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-89295b6e-02e8-442a-8458-e11a7c9da9be None None] MFA Rules not processed for user `e3a33f6fa8494faea3791a72c2203e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:45.976912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-89295b6e-02e8-442a-8458-e11a7c9da9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:46.038747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.099707 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 667/1318] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:56:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:46.142443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335d4da-ec51-49f7-af11-94f0676572b8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.144944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a335d4da-ec51-49f7-af11-94f0676572b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:46.273062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335d4da-ec51-49f7-af11-94f0676572b8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.275854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.352175 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358143f-abd9-4087-8e9f-2c01069fb5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.352863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358143f-abd9-4087-8e9f-2c01069fb5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.353145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358143f-abd9-4087-8e9f-2c01069fb5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.353423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358143f-abd9-4087-8e9f-2c01069fb5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.355073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8358143f-abd9-4087-8e9f-2c01069fb5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:46.471621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358143f-abd9-4087-8e9f-2c01069fb5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.473023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358143f-abd9-4087-8e9f-2c01069fb5f5 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.491278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 652/1319] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 11:56:49.297173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73806f-0fcd-454d-970f-e10d551e6c93 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.297720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73806f-0fcd-454d-970f-e10d551e6c93 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.297720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73806f-0fcd-454d-970f-e10d551e6c93 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.299005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 668/1320] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:49.305493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1b53-35e6-465c-bd7f-afbf4a20c42d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.306174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1b53-35e6-465c-bd7f-afbf4a20c42d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.306362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb1b53-35e6-465c-bd7f-afbf4a20c42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.358111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.386013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-71fb1b53-35e6-465c-bd7f-afbf4a20c42d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:49.387228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-71fb1b53-35e6-465c-bd7f-afbf4a20c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:49.494208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 653/1321] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:49.541812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73806f-0fcd-454d-970f-e10d551e6c93 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.543700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da73806f-0fcd-454d-970f-e10d551e6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:49.656343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73806f-0fcd-454d-970f-e10d551e6c93 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.730174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e529e-38ac-47b5-b643-7d56ec9de297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.730802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e529e-38ac-47b5-b643-7d56ec9de297 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.731078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e529e-38ac-47b5-b643-7d56ec9de297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.731344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e529e-38ac-47b5-b643-7d56ec9de297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.733160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ad4e529e-38ac-47b5-b643-7d56ec9de297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:49.740502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.856601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e529e-38ac-47b5-b643-7d56ec9de297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.858119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e529e-38ac-47b5-b643-7d56ec9de297 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.876814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 669/1322] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:56:52.730702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af18e5-e8fc-48b5-9a2c-f773db8b3eb6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.731234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af18e5-e8fc-48b5-9a2c-f773db8b3eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.731353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af18e5-e8fc-48b5-9a2c-f773db8b3eb6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.732687 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 654/1323] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:52.738272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46766afd-1121-42f5-9ca0-abcf1eee829f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.738646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46766afd-1121-42f5-9ca0-abcf1eee829f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.738920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46766afd-1121-42f5-9ca0-abcf1eee829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.808332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-46766afd-1121-42f5-9ca0-abcf1eee829f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:52.809587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-46766afd-1121-42f5-9ca0-abcf1eee829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:52.872782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.913862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 670/1324] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:52.949960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af18e5-e8fc-48b5-9a2c-f773db8b3eb6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.951548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a2af18e5-e8fc-48b5-9a2c-f773db8b3eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:53.060571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af18e5-e8fc-48b5-9a2c-f773db8b3eb6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:53.074302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:53.137265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db95be7-98bb-4d0f-9db7-aabe507d1a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:53.137904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95be7-98bb-4d0f-9db7-aabe507d1a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:53.138173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95be7-98bb-4d0f-9db7-aabe507d1a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:53.138434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95be7-98bb-4d0f-9db7-aabe507d1a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:53.140060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3db95be7-98bb-4d0f-9db7-aabe507d1a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:53.249342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db95be7-98bb-4d0f-9db7-aabe507d1a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:53.250773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db95be7-98bb-4d0f-9db7-aabe507d1a6d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:53.269282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 655/1325] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:56:55.508337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df6a8-8e69-4bd5-a7fd-aa2d278fddfc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.508825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df6a8-8e69-4bd5-a7fd-aa2d278fddfc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.508934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df6a8-8e69-4bd5-a7fd-aa2d278fddfc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.510293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 671/1326] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:55.515906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de2d8-9d67-4c34-af20-930743ae5c58 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.516308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de2d8-9d67-4c34-af20-930743ae5c58 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.516480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26de2d8-9d67-4c34-af20-930743ae5c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.565569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:55.586023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f26de2d8-9d67-4c34-af20-930743ae5c58 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:55.587234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f26de2d8-9d67-4c34-af20-930743ae5c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:55.686844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 656/1327] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:55.722440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2df6a8-8e69-4bd5-a7fd-aa2d278fddfc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:55.723962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2c2df6a8-8e69-4bd5-a7fd-aa2d278fddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:55.832610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2df6a8-8e69-4bd5-a7fd-aa2d278fddfc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:55.909420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1cd2b-c4ab-4e37-88de-890f79c7d67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:55.910066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1cd2b-c4ab-4e37-88de-890f79c7d67f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.910354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1cd2b-c4ab-4e37-88de-890f79c7d67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.910618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1cd2b-c4ab-4e37-88de-890f79c7d67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.912347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-60c1cd2b-c4ab-4e37-88de-890f79c7d67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:55.929198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:56.026125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1cd2b-c4ab-4e37-88de-890f79c7d67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:56.027585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1cd2b-c4ab-4e37-88de-890f79c7d67f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:56.046844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 672/1328] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:56:58.305153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3cb2-0d3a-44b0-a076-4ddd92dbdcbb None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.305709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3cb2-0d3a-44b0-a076-4ddd92dbdcbb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.305709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f3cb2-0d3a-44b0-a076-4ddd92dbdcbb None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.307087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 657/1329] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:58.312573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6693d-00be-4240-a3d1-7b470f203e49 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.313034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6693d-00be-4240-a3d1-7b470f203e49 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.313121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6693d-00be-4240-a3d1-7b470f203e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.379138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aea6693d-00be-4240-a3d1-7b470f203e49 None None] MFA Rules not processed for user `e3a33f6fa8494faea3791a72c2203e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:58.380338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aea6693d-00be-4240-a3d1-7b470f203e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:58.449003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.483924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 673/1330] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:56:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:56:58.521984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3cb2-0d3a-44b0-a076-4ddd92dbdcbb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.523878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-968f3cb2-0d3a-44b0-a076-4ddd92dbdcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:58.634078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f3cb2-0d3a-44b0-a076-4ddd92dbdcbb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.657152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.711354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e24eda-7ccd-4607-8aaa-ec629cde58de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.712002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24eda-7ccd-4607-8aaa-ec629cde58de service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.712275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24eda-7ccd-4607-8aaa-ec629cde58de service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.712545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24eda-7ccd-4607-8aaa-ec629cde58de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.714218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b6e24eda-7ccd-4607-8aaa-ec629cde58de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:58.829781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e24eda-7ccd-4607-8aaa-ec629cde58de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.831239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e24eda-7ccd-4607-8aaa-ec629cde58de service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.850686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 658/1331] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:01.452769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c48e4b-41e2-4dab-a2b1-1f2bf1c24a8c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.453281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c48e4b-41e2-4dab-a2b1-1f2bf1c24a8c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.453281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c48e4b-41e2-4dab-a2b1-1f2bf1c24a8c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.455297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 674/1332] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:01.462539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d2c29-35d8-45a9-a9c1-a7d911ca03b7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.462942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d2c29-35d8-45a9-a9c1-a7d911ca03b7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.463080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d2c29-35d8-45a9-a9c1-a7d911ca03b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.541615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.546108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-294d2c29-35d8-45a9-a9c1-a7d911ca03b7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:01.549083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-294d2c29-35d8-45a9-a9c1-a7d911ca03b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:01.656105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 659/1333] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:01.697189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c48e4b-41e2-4dab-a2b1-1f2bf1c24a8c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.698718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7c48e4b-41e2-4dab-a2b1-1f2bf1c24a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:01.813264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c48e4b-41e2-4dab-a2b1-1f2bf1c24a8c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.891897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34418129-6e82-4556-8dae-2101285bdf6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.892566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34418129-6e82-4556-8dae-2101285bdf6b service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.892894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34418129-6e82-4556-8dae-2101285bdf6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.893169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34418129-6e82-4556-8dae-2101285bdf6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.894849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-34418129-6e82-4556-8dae-2101285bdf6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:01.924499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:02.008556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34418129-6e82-4556-8dae-2101285bdf6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:02.010041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34418129-6e82-4556-8dae-2101285bdf6b service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:02.029211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 675/1334] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 11:57:04.315475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43c00-c976-41a4-a175-a7d26d59ab9d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.316289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43c00-c976-41a4-a175-a7d26d59ab9d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.316407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43c00-c976-41a4-a175-a7d26d59ab9d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.318541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 660/1335] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:04.327409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5da92-b67c-4423-81b3-fbcdd4c31c00 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.328173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5da92-b67c-4423-81b3-fbcdd4c31c00 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.328329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5da92-b67c-4423-81b3-fbcdd4c31c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.398797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a6b5da92-b67c-4423-81b3-fbcdd4c31c00 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:04.400018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6b5da92-b67c-4423-81b3-fbcdd4c31c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:04.480617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.506172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 676/1336] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:04.548614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43c00-c976-41a4-a175-a7d26d59ab9d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.550171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aef43c00-c976-41a4-a175-a7d26d59ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:04.668943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43c00-c976-41a4-a175-a7d26d59ab9d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.699021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.746670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546843e-1c61-4dc7-b294-871c598e8349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.747365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546843e-1c61-4dc7-b294-871c598e8349 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.747641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546843e-1c61-4dc7-b294-871c598e8349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.747909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546843e-1c61-4dc7-b294-871c598e8349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.749572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f546843e-1c61-4dc7-b294-871c598e8349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:04.871833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546843e-1c61-4dc7-b294-871c598e8349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.873328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546843e-1c61-4dc7-b294-871c598e8349 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.892838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 661/1337] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:07.583601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01670feb-dd66-4b75-8dc8-abb45ce37f9d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:07.584205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01670feb-dd66-4b75-8dc8-abb45ce37f9d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:07.584205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01670feb-dd66-4b75-8dc8-abb45ce37f9d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:07.586291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 677/1338] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:07.594120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bb2ac-4727-4469-9adf-0cb1a2d293ff None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:07.594589 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bb2ac-4727-4469-9adf-0cb1a2d293ff None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:07.594695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bb2ac-4727-4469-9adf-0cb1a2d293ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:07.661114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-853bb2ac-4727-4469-9adf-0cb1a2d293ff None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:07.662308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-853bb2ac-4727-4469-9adf-0cb1a2d293ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:07.670995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:07.766896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 662/1339] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:07.806104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01670feb-dd66-4b75-8dc8-abb45ce37f9d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:07.808508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-01670feb-dd66-4b75-8dc8-abb45ce37f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:07.932557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01670feb-dd66-4b75-8dc8-abb45ce37f9d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:08.016024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13af74-0e4d-45e4-a99b-d45bf6ac346e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:08.016740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13af74-0e4d-45e4-a99b-d45bf6ac346e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:08.017083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13af74-0e4d-45e4-a99b-d45bf6ac346e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:08.017277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13af74-0e4d-45e4-a99b-d45bf6ac346e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:08.018929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4d13af74-0e4d-45e4-a99b-d45bf6ac346e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:08.055766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:08.132919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13af74-0e4d-45e4-a99b-d45bf6ac346e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:08.134373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13af74-0e4d-45e4-a99b-d45bf6ac346e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:08.156226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 678/1340] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:12.458382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f043b36-01c6-4671-8239-92ffa594046c None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.458924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f043b36-01c6-4671-8239-92ffa594046c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.458924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f043b36-01c6-4671-8239-92ffa594046c None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.460382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 663/1341] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:12.466041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f87f-bc79-45de-a894-ba551fb60d30 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.466439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f87f-bc79-45de-a894-ba551fb60d30 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.466617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f87f-bc79-45de-a894-ba551fb60d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.545089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-40e9f87f-bc79-45de-a894-ba551fb60d30 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:12.546301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40e9f87f-bc79-45de-a894-ba551fb60d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:12.643956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.658414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 679/1342] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:12.697178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f043b36-01c6-4671-8239-92ffa594046c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.699490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7f043b36-01c6-4671-8239-92ffa594046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:12.799219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f043b36-01c6-4671-8239-92ffa594046c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.802786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c3847-5448-40cf-ad6c-636f270541c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.803444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3847-5448-40cf-ad6c-636f270541c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.803754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3847-5448-40cf-ad6c-636f270541c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.804025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3847-5448-40cf-ad6c-636f270541c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.813114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c3847-5448-40cf-ad6c-636f270541c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.814542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c3847-5448-40cf-ad6c-636f270541c5 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.823756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 664/1343] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:15.653622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32b706-10e8-4040-b8ee-cdaf344429dc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.654173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32b706-10e8-4040-b8ee-cdaf344429dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.654173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32b706-10e8-4040-b8ee-cdaf344429dc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.655781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 680/1344] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:15.660876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7f6d7-0182-4581-bfb9-5dcee04415ba None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.661331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7f6d7-0182-4581-bfb9-5dcee04415ba None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.661412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7f6d7-0182-4581-bfb9-5dcee04415ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.691279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dba7f6d7-0182-4581-bfb9-5dcee04415ba None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:15.692469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dba7f6d7-0182-4581-bfb9-5dcee04415ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:15.722883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:15.773540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 665/1345] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:15.809946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32b706-10e8-4040-b8ee-cdaf344429dc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.811979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c32b706-10e8-4040-b8ee-cdaf344429dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:15.826496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32b706-10e8-4040-b8ee-cdaf344429dc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.830345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676559aa-91f6-47d0-bc04-04bc0ab8300a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.831030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676559aa-91f6-47d0-bc04-04bc0ab8300a service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.831308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676559aa-91f6-47d0-bc04-04bc0ab8300a service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.831577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676559aa-91f6-47d0-bc04-04bc0ab8300a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.841519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676559aa-91f6-47d0-bc04-04bc0ab8300a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:15.842960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676559aa-91f6-47d0-bc04-04bc0ab8300a service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:15.852518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 681/1346] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:19.980942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f098-60af-4132-9268-e3e5c741ee9d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.981460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f098-60af-4132-9268-e3e5c741ee9d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.981460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f098-60af-4132-9268-e3e5c741ee9d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.982832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 666/1347] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:19.988289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e9fa-2a24-44e0-8c5e-f352b5e7c788 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.988774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e9fa-2a24-44e0-8c5e-f352b5e7c788 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.988870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e9fa-2a24-44e0-8c5e-f352b5e7c788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.008885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fa23e9fa-2a24-44e0-8c5e-f352b5e7c788 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:20.010068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fa23e9fa-2a24-44e0-8c5e-f352b5e7c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:20.018666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 682/1348] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:20.063231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6f098-60af-4132-9268-e3e5c741ee9d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:20.075138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6f098-60af-4132-9268-e3e5c741ee9d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:20.078743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053655c0-3149-4afd-b0ad-42c056e32daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:20.079377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053655c0-3149-4afd-b0ad-42c056e32daf service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:20.079650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053655c0-3149-4afd-b0ad-42c056e32daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:20.079917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053655c0-3149-4afd-b0ad-42c056e32daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:20.089641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053655c0-3149-4afd-b0ad-42c056e32daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:20.091075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053655c0-3149-4afd-b0ad-42c056e32daf service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:20.101159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 667/1349] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:25.541210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143dcdf-355f-41af-917f-cf017c1dbba3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.541737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143dcdf-355f-41af-917f-cf017c1dbba3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.541737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143dcdf-355f-41af-917f-cf017c1dbba3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.543137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 683/1350] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 11:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:25.548696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034330-4fc7-42eb-8ffb-701b58d8e286 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.549164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034330-4fc7-42eb-8ffb-701b58d8e286 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.549270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034330-4fc7-42eb-8ffb-701b58d8e286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.628565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c6034330-4fc7-42eb-8ffb-701b58d8e286 None None] MFA Rules not processed for user `1f1c8f34e83d45c99e25f7fe3711e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:25.629944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c6034330-4fc7-42eb-8ffb-701b58d8e286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:25.765876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 668/1351] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:29.778119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b999-6d5d-4dda-a72c-9b16af635a4d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.780546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b999-6d5d-4dda-a72c-9b16af635a4d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.780546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b999-6d5d-4dda-a72c-9b16af635a4d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.780546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 684/1352] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 11:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:29.785504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328761b7-d55f-4db5-9a76-5bf3ed312110 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:29.785982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328761b7-d55f-4db5-9a76-5bf3ed312110 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:29.786261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328761b7-d55f-4db5-9a76-5bf3ed312110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:29.806078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-328761b7-d55f-4db5-9a76-5bf3ed312110 None None] MFA Rules not processed for user `1f1c8f34e83d45c99e25f7fe3711e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:29.807587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-328761b7-d55f-4db5-9a76-5bf3ed312110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:29.816847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 669/1353] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 11:57:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:30.002673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=13 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:31.500682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38735f63-8909-4928-8eb4-1f5929d635dc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.500682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38735f63-8909-4928-8eb4-1f5929d635dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.500682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38735f63-8909-4928-8eb4-1f5929d635dc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.502488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 685/1354] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 11:57:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:31.508858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fe6b3-226c-4daf-9be0-b7311659ba3e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:31.509312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fe6b3-226c-4daf-9be0-b7311659ba3e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:31.509390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fe6b3-226c-4daf-9be0-b7311659ba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:31.529956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-491fe6b3-226c-4daf-9be0-b7311659ba3e None None] MFA Rules not processed for user `1f1c8f34e83d45c99e25f7fe3711e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:31.531181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-491fe6b3-226c-4daf-9be0-b7311659ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:31.540992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 670/1355] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 11:57:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:35.380569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b2c0-537f-428c-9108-9dd0b94b1436 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.381470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b2c0-537f-428c-9108-9dd0b94b1436 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.381892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b2c0-537f-428c-9108-9dd0b94b1436 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.387490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 686/1356] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:35.388906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d840280-974b-4184-a41b-a8f60f3f1b72 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.389683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d840280-974b-4184-a41b-a8f60f3f1b72 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.390144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d840280-974b-4184-a41b-a8f60f3f1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.413945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2d840280-974b-4184-a41b-a8f60f3f1b72 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:35.415390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2d840280-974b-4184-a41b-a8f60f3f1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:35.424156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 671/1357] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:35.481814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c910c-0234-4ff6-a333-44500b7d7b54 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.482399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c910c-0234-4ff6-a333-44500b7d7b54 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.482826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c910c-0234-4ff6-a333-44500b7d7b54 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.484778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 687/1358] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 11:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:35.504750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51096e9-7efb-4d10-8013-a5ddb2730c8e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.504750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51096e9-7efb-4d10-8013-a5ddb2730c8e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.505492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51096e9-7efb-4d10-8013-a5ddb2730c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.552117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:35.561734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f51096e9-7efb-4d10-8013-a5ddb2730c8e None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:35.562922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f51096e9-7efb-4d10-8013-a5ddb2730c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:35.649011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 672/1359] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 11:57:35.657171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c910c-0234-4ff6-a333-44500b7d7b54 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:35.671992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c910c-0234-4ff6-a333-44500b7d7b54 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:35.677757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c587a-c519-4909-b15a-5a68ed7bf94f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:35.678675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c587a-c519-4909-b15a-5a68ed7bf94f service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:35.679173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c587a-c519-4909-b15a-5a68ed7bf94f service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:35.679469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c587a-c519-4909-b15a-5a68ed7bf94f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:35.688276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c587a-c519-4909-b15a-5a68ed7bf94f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:35.690021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c587a-c519-4909-b15a-5a68ed7bf94f service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:35.700207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 688/1360] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:38.169237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40d1d-af9e-4281-9f7e-e2bbf0d431a8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:38.169804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40d1d-af9e-4281-9f7e-e2bbf0d431a8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:38.169804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40d1d-af9e-4281-9f7e-e2bbf0d431a8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:38.171232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 673/1361] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:57:38.176552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eab76-5711-44f3-9447-6ed870edbe2d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:38.177435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eab76-5711-44f3-9447-6ed870edbe2d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:38.177678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eab76-5711-44f3-9447-6ed870edbe2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:38.195917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7c7eab76-5711-44f3-9447-6ed870edbe2d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:38.197132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c7eab76-5711-44f3-9447-6ed870edbe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:38.205297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 689/1362] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:38.253124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d40d1d-af9e-4281-9f7e-e2bbf0d431a8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:38.268788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d40d1d-af9e-4281-9f7e-e2bbf0d431a8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:38.274175 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1e51-3d6d-41d0-8a5f-c05ada74358d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:38.274812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1e51-3d6d-41d0-8a5f-c05ada74358d service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:38.275514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1e51-3d6d-41d0-8a5f-c05ada74358d service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:38.275788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1e51-3d6d-41d0-8a5f-c05ada74358d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:38.284855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1e51-3d6d-41d0-8a5f-c05ada74358d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:38.286609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1e51-3d6d-41d0-8a5f-c05ada74358d service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:38.296857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 674/1363] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:40.791927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83676b-477c-4a27-9c83-b65b94857c41 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.792511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83676b-477c-4a27-9c83-b65b94857c41 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.792511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83676b-477c-4a27-9c83-b65b94857c41 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.793837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 690/1364] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:40.799817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523d179-b3c7-41ef-81c7-b2bc96cc7bc3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.800363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523d179-b3c7-41ef-81c7-b2bc96cc7bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.800363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523d179-b3c7-41ef-81c7-b2bc96cc7bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.822600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2523d179-b3c7-41ef-81c7-b2bc96cc7bc3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:40.823826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2523d179-b3c7-41ef-81c7-b2bc96cc7bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:40.831819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 675/1365] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:40.890538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f79b9-d004-48a4-ba34-cf58b2c7def3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.891198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f79b9-d004-48a4-ba34-cf58b2c7def3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.891703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f79b9-d004-48a4-ba34-cf58b2c7def3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.893737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 691/1366] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 11:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:40.902124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171decba-c003-492f-9ed6-541807330fc8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.902701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171decba-c003-492f-9ed6-541807330fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.903234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171decba-c003-492f-9ed6-541807330fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.926214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-171decba-c003-492f-9ed6-541807330fc8 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:40.927409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-171decba-c003-492f-9ed6-541807330fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:40.936703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 676/1367] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:40.945307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f79b9-d004-48a4-ba34-cf58b2c7def3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.960266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f79b9-d004-48a4-ba34-cf58b2c7def3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.965881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b94c7-bf5d-49cc-b425-b746b21b95fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.966523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b94c7-bf5d-49cc-b425-b746b21b95fc service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.966797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b94c7-bf5d-49cc-b425-b746b21b95fc service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.967064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b94c7-bf5d-49cc-b425-b746b21b95fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.975364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b94c7-bf5d-49cc-b425-b746b21b95fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.977037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b94c7-bf5d-49cc-b425-b746b21b95fc service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.986256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 692/1368] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:43.262291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea33bff-2b17-4d27-a6a7-510216966843 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.262824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea33bff-2b17-4d27-a6a7-510216966843 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.262824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea33bff-2b17-4d27-a6a7-510216966843 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.264123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 677/1369] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:43.269920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5752f-4e19-4d09-ac03-26dd94a40e26 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.270454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5752f-4e19-4d09-ac03-26dd94a40e26 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.270454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5752f-4e19-4d09-ac03-26dd94a40e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.288856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-32e5752f-4e19-4d09-ac03-26dd94a40e26 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:43.290085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-32e5752f-4e19-4d09-ac03-26dd94a40e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:43.304790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 693/1370] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:43.341779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea33bff-2b17-4d27-a6a7-510216966843 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:43.357388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea33bff-2b17-4d27-a6a7-510216966843 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:43.364210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a087a-a619-4cc5-9fa3-11a7f15e02d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:43.365064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a087a-a619-4cc5-9fa3-11a7f15e02d4 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.365478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a087a-a619-4cc5-9fa3-11a7f15e02d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.365848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a087a-a619-4cc5-9fa3-11a7f15e02d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.377997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a087a-a619-4cc5-9fa3-11a7f15e02d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:43.379921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a087a-a619-4cc5-9fa3-11a7f15e02d4 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:43.392974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 678/1371] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:43.557630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a3c09-c78a-4cb3-92b2-397b5b8cb0e6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.557862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a3c09-c78a-4cb3-92b2-397b5b8cb0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.558020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a3c09-c78a-4cb3-92b2-397b5b8cb0e6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.559794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 694/1372] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:43.566114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dcc15-3adc-46b9-9ba1-87cb7f7bbb17 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.566407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dcc15-3adc-46b9-9ba1-87cb7f7bbb17 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.566639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dcc15-3adc-46b9-9ba1-87cb7f7bbb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.586902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3e2dcc15-3adc-46b9-9ba1-87cb7f7bbb17 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:43.588608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3e2dcc15-3adc-46b9-9ba1-87cb7f7bbb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:43.598389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 679/1373] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:43.905149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783ec8d-a9eb-4535-95b2-ca75e543828d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.905149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783ec8d-a9eb-4535-95b2-ca75e543828d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.905149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783ec8d-a9eb-4535-95b2-ca75e543828d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.905149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 695/1374] 10.222.0.35 () {54 vars in 963 bytes} [Thu May 19 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:43.909359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ed13-972a-4eb0-bb2e-14a30d52011c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:43.909820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ed13-972a-4eb0-bb2e-14a30d52011c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:43.910078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ed13-972a-4eb0-bb2e-14a30d52011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:43.963985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7761ed13-972a-4eb0-bb2e-14a30d52011c None None] MFA Rules not processed for user `8935a1ea9f94443f903d479401706473`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:43.965199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7761ed13-972a-4eb0-bb2e-14a30d52011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:44.028057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 680/1375] 10.222.0.35 () {58 vars in 1060 bytes} [Thu May 19 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:44.035923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783ec8d-a9eb-4535-95b2-ca75e543828d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:44.046988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783ec8d-a9eb-4535-95b2-ca75e543828d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:44.050527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b0c6d-a51a-4989-b70a-d80f57768950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:44.051368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0c6d-a51a-4989-b70a-d80f57768950 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:44.051802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0c6d-a51a-4989-b70a-d80f57768950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:44.052235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0c6d-a51a-4989-b70a-d80f57768950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:44.062060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b0c6d-a51a-4989-b70a-d80f57768950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:44.063689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b0c6d-a51a-4989-b70a-d80f57768950 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:44.073946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 696/1376] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:45.647617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66c3f4-210e-41e6-9532-da21fd82cf6a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.648180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66c3f4-210e-41e6-9532-da21fd82cf6a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.648180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66c3f4-210e-41e6-9532-da21fd82cf6a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.649869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 681/1377] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:45.655921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b43b-4cef-4853-b295-603c3ace6b29 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.656390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b43b-4cef-4853-b295-603c3ace6b29 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.656484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b43b-4cef-4853-b295-603c3ace6b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.675535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a7b6b43b-4cef-4853-b295-603c3ace6b29 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:45.676727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a7b6b43b-4cef-4853-b295-603c3ace6b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:45.685071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 697/1378] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:45.729463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66c3f4-210e-41e6-9532-da21fd82cf6a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:45.755568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66c3f4-210e-41e6-9532-da21fd82cf6a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:45.762103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b8077-0a2d-4d39-9350-b9d0e26aa34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:45.762860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b8077-0a2d-4d39-9350-b9d0e26aa34e service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:45.763163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b8077-0a2d-4d39-9350-b9d0e26aa34e service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:45.763426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b8077-0a2d-4d39-9350-b9d0e26aa34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:45.773031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b8077-0a2d-4d39-9350-b9d0e26aa34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:45.774753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b8077-0a2d-4d39-9350-b9d0e26aa34e service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:45.779420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:45.786578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 682/1379] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:48.038450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a330b-bcf2-45d0-b2f8-550796eed24d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.039361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a330b-bcf2-45d0-b2f8-550796eed24d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.039634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a330b-bcf2-45d0-b2f8-550796eed24d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.041248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 698/1380] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:48.046698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf270-769c-48dd-a285-81befac3bab8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.047096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf270-769c-48dd-a285-81befac3bab8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.047241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf270-769c-48dd-a285-81befac3bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.067613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9e4cf270-769c-48dd-a285-81befac3bab8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:48.068840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9e4cf270-769c-48dd-a285-81befac3bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:48.077118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 683/1381] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:48.120480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a330b-bcf2-45d0-b2f8-550796eed24d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:48.140145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a330b-bcf2-45d0-b2f8-550796eed24d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:48.145817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6f62c-24c3-4402-b030-c2a20f71322f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:48.146464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6f62c-24c3-4402-b030-c2a20f71322f service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:48.146726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6f62c-24c3-4402-b030-c2a20f71322f service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:48.146992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6f62c-24c3-4402-b030-c2a20f71322f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:48.157274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6f62c-24c3-4402-b030-c2a20f71322f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:48.158852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6f62c-24c3-4402-b030-c2a20f71322f service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:48.168953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 699/1382] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:50.435828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc293e-258b-4070-a501-e496c83d6343 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.436376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc293e-258b-4070-a501-e496c83d6343 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.436376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc293e-258b-4070-a501-e496c83d6343 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.437630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 684/1383] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:50.443185 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dabc8-0a39-4c36-8ad4-4c0443d7cca7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.443639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dabc8-0a39-4c36-8ad4-4c0443d7cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.443888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dabc8-0a39-4c36-8ad4-4c0443d7cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.462994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6e2dabc8-0a39-4c36-8ad4-4c0443d7cca7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:50.464165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e2dabc8-0a39-4c36-8ad4-4c0443d7cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:50.472819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 700/1384] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:50.515899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc293e-258b-4070-a501-e496c83d6343 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:50.531191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc293e-258b-4070-a501-e496c83d6343 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:50.537151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb279dc-5099-4b4a-94ce-e0e6eeb57f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:50.537842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb279dc-5099-4b4a-94ce-e0e6eeb57f6d service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:50.538123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb279dc-5099-4b4a-94ce-e0e6eeb57f6d service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:50.538396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb279dc-5099-4b4a-94ce-e0e6eeb57f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:50.548441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb279dc-5099-4b4a-94ce-e0e6eeb57f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:50.550126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb279dc-5099-4b4a-94ce-e0e6eeb57f6d service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:50.561902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 685/1385] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:52.833856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347025c6-7390-49b0-9dea-be77fb44b894 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.834442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347025c6-7390-49b0-9dea-be77fb44b894 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.834442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347025c6-7390-49b0-9dea-be77fb44b894 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.835866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 701/1386] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:52.841883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee469f-e5b9-4a68-8bb3-41d0e0530132 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.842355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee469f-e5b9-4a68-8bb3-41d0e0530132 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.842644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee469f-e5b9-4a68-8bb3-41d0e0530132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.866642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-09ee469f-e5b9-4a68-8bb3-41d0e0530132 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:52.868534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-09ee469f-e5b9-4a68-8bb3-41d0e0530132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:52.880695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 686/1387] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:52.927630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347025c6-7390-49b0-9dea-be77fb44b894 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:52.946237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347025c6-7390-49b0-9dea-be77fb44b894 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:52.953106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88701914-a717-475c-a428-0340ceabde15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:52.953916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88701914-a717-475c-a428-0340ceabde15 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:52.954254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88701914-a717-475c-a428-0340ceabde15 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:52.954606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88701914-a717-475c-a428-0340ceabde15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:52.966302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88701914-a717-475c-a428-0340ceabde15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:52.968316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88701914-a717-475c-a428-0340ceabde15 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:52.980725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 702/1388] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:55.923667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c17c-c4e5-408a-9326-50562bf477aa None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.924221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c17c-c4e5-408a-9326-50562bf477aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.924221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c17c-c4e5-408a-9326-50562bf477aa None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.925981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 687/1389] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:55.932615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6aa25-b854-43c2-b246-1d2bb3bc8406 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:55.933067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6aa25-b854-43c2-b246-1d2bb3bc8406 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:55.933163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6aa25-b854-43c2-b246-1d2bb3bc8406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:55.954505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-12f6aa25-b854-43c2-b246-1d2bb3bc8406 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:55.955858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-12f6aa25-b854-43c2-b246-1d2bb3bc8406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:55.964760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 703/1390] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 11:57:56.011608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4c17c-c4e5-408a-9326-50562bf477aa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:56.026799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4c17c-c4e5-408a-9326-50562bf477aa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:56.032384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8af135-df39-4f14-8dc9-14f27c8bfd4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:56.033053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8af135-df39-4f14-8dc9-14f27c8bfd4e service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:56.033331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8af135-df39-4f14-8dc9-14f27c8bfd4e service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:56.033618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8af135-df39-4f14-8dc9-14f27c8bfd4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:56.042000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8af135-df39-4f14-8dc9-14f27c8bfd4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:56.043577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8af135-df39-4f14-8dc9-14f27c8bfd4e service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:56.053022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 688/1391] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:58.337623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e77f-f575-4efe-9913-cb8edbd84ff4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.338556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e77f-f575-4efe-9913-cb8edbd84ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.338834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e77f-f575-4efe-9913-cb8edbd84ff4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.340305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 704/1392] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:58.346044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a98d7-46ad-4dd3-b47e-9d95a4d3fe33 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.346540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a98d7-46ad-4dd3-b47e-9d95a4d3fe33 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.346540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a98d7-46ad-4dd3-b47e-9d95a4d3fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.365081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-db3a98d7-46ad-4dd3-b47e-9d95a4d3fe33 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:58.366260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db3a98d7-46ad-4dd3-b47e-9d95a4d3fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:58.374422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 689/1393] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:58.417429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1e77f-f575-4efe-9913-cb8edbd84ff4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:58.432992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1e77f-f575-4efe-9913-cb8edbd84ff4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:58.438769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99420-4ad4-41f1-99c8-7cb6c89c76b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:58.439430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99420-4ad4-41f1-99c8-7cb6c89c76b4 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:58.439709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99420-4ad4-41f1-99c8-7cb6c89c76b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:58.439978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99420-4ad4-41f1-99c8-7cb6c89c76b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:58.448568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99420-4ad4-41f1-99c8-7cb6c89c76b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:58.450306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99420-4ad4-41f1-99c8-7cb6c89c76b4 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:58.460404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 705/1394] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:57:59.724254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46fea5-fa21-4a74-9c1c-e0395e187af7 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.724860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46fea5-fa21-4a74-9c1c-e0395e187af7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.724860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46fea5-fa21-4a74-9c1c-e0395e187af7 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.726243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 690/1395] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:59.731654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed510-af28-4a54-a6dc-6815b58d3b45 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.732119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed510-af28-4a54-a6dc-6815b58d3b45 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.732220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed510-af28-4a54-a6dc-6815b58d3b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.750251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fb6ed510-af28-4a54-a6dc-6815b58d3b45 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:59.751450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fb6ed510-af28-4a54-a6dc-6815b58d3b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:59.759625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 706/1396] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:59.814675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6011ff-6ae4-4009-bed8-278982ec923d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.815055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6011ff-6ae4-4009-bed8-278982ec923d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.815397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6011ff-6ae4-4009-bed8-278982ec923d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.816917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 691/1397] 10.222.0.35 () {54 vars in 962 bytes} [Thu May 19 11:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:59.821998 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62e3e4-dde6-44bf-960b-34fedf98d0c4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.822284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62e3e4-dde6-44bf-960b-34fedf98d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.822550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62e3e4-dde6-44bf-960b-34fedf98d0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.882295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bb62e3e4-dde6-44bf-960b-34fedf98d0c4 None None] MFA Rules not processed for user `9f1470011d984f45be788072525f82cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:59.883534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bb62e3e4-dde6-44bf-960b-34fedf98d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:59.944729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 707/1398] 10.222.0.35 () {58 vars in 1059 bytes} [Thu May 19 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:57:59.952602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6011ff-6ae4-4009-bed8-278982ec923d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:59.964459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6011ff-6ae4-4009-bed8-278982ec923d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:59.968673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee35f8f-8789-47ab-b667-d395965ca881 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1470011d984f45be788072525f82cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:59.969334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee35f8f-8789-47ab-b667-d395965ca881 service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:59.969613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee35f8f-8789-47ab-b667-d395965ca881 service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:59.969888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee35f8f-8789-47ab-b667-d395965ca881 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:59.979975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee35f8f-8789-47ab-b667-d395965ca881 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:59.981418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee35f8f-8789-47ab-b667-d395965ca881 service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:59.990863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 692/1399] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 11:58:00.529479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d9a6e-13a5-414f-aeab-2352541b4ca1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.529758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d9a6e-13a5-414f-aeab-2352541b4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.530084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d9a6e-13a5-414f-aeab-2352541b4ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.535411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:00.579243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f80d9a6e-13a5-414f-aeab-2352541b4ca1 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:00.580448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f80d9a6e-13a5-414f-aeab-2352541b4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:00.646731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 708/1400] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:00.678947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19190825-2120-41ac-89b7-85ba04e91eba None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.679239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19190825-2120-41ac-89b7-85ba04e91eba None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.679562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19190825-2120-41ac-89b7-85ba04e91eba None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.681086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 693/1401] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:00.687064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c445994-a7de-42d0-b1c1-f6bc731b7e9b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.687364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c445994-a7de-42d0-b1c1-f6bc731b7e9b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.687638 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c445994-a7de-42d0-b1c1-f6bc731b7e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.688233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f253b9a-7e6f-45e8-8c15-2bbdac4a56d9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.688501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f253b9a-7e6f-45e8-8c15-2bbdac4a56d9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.689010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f253b9a-7e6f-45e8-8c15-2bbdac4a56d9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.690284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 694/1402] 10.222.0.35 () {54 vars in 942 bytes} [Thu May 19 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:00.696718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43011c-bbba-4983-8281-ac48a20d593d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.697002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43011c-bbba-4983-8281-ac48a20d593d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.697272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43011c-bbba-4983-8281-ac48a20d593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.705553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0c445994-a7de-42d0-b1c1-f6bc731b7e9b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:00.706751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0c445994-a7de-42d0-b1c1-f6bc731b7e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:00.714693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 709/1403] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:00.745094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cf43011c-bbba-4983-8281-ac48a20d593d None None] MFA Rules not processed for user `aa37bb31a4fa42d5937b70c993a994fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:00.747337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cf43011c-bbba-4983-8281-ac48a20d593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:00.758532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c445994-a7de-42d0-b1c1-f6bc731b7e9b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.770363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c445994-a7de-42d0-b1c1-f6bc731b7e9b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.777772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.779812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.780094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.781408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.790309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.792255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.802083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 710/1404] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 11:58:00.821931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 695/1405] 10.222.0.35 () {58 vars in 1039 bytes} [Thu May 19 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:00.831174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:00.842703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3154-eb60-4804-a4d4-13bb2867ad50 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:00.848062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e8d4-a9f7-46a3-b843-7a882ffbb0bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:00.848710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e8d4-a9f7-46a3-b843-7a882ffbb0bf service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:00.848999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e8d4-a9f7-46a3-b843-7a882ffbb0bf service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:00.849263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e8d4-a9f7-46a3-b843-7a882ffbb0bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:00.858841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6e8d4-a9f7-46a3-b843-7a882ffbb0bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:00.860431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6e8d4-a9f7-46a3-b843-7a882ffbb0bf service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:00.868876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 711/1406] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 11:58:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 11:58:03.123801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd550e-578a-481b-80d8-7bb0f480d35b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:03.124832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd550e-578a-481b-80d8-7bb0f480d35b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:03.125111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd550e-578a-481b-80d8-7bb0f480d35b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:03.126669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 696/1407] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:03.132035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408182e-fcfc-49fb-8d1b-66e5f8b12cba None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:03.132465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408182e-fcfc-49fb-8d1b-66e5f8b12cba None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:03.132618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408182e-fcfc-49fb-8d1b-66e5f8b12cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:03.153652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2408182e-fcfc-49fb-8d1b-66e5f8b12cba None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:03.154905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2408182e-fcfc-49fb-8d1b-66e5f8b12cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:03.164805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 712/1408] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:03.207109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd550e-578a-481b-80d8-7bb0f480d35b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:03.223465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd550e-578a-481b-80d8-7bb0f480d35b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:03.230031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a869c7-f6e3-45ff-80fc-de87439d46a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:03.230678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a869c7-f6e3-45ff-80fc-de87439d46a1 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:03.230954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a869c7-f6e3-45ff-80fc-de87439d46a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:03.231224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a869c7-f6e3-45ff-80fc-de87439d46a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:03.240211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a869c7-f6e3-45ff-80fc-de87439d46a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:03.241808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a869c7-f6e3-45ff-80fc-de87439d46a1 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:03.252513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 697/1409] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:13.147658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=57 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:13.304724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=78 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:24.069050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7880f3-a099-493c-9062-39c65726cb43 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.069677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7880f3-a099-493c-9062-39c65726cb43 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.069677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7880f3-a099-493c-9062-39c65726cb43 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.070980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 713/1410] 10.222.0.35 () {54 vars in 918 bytes} [Thu May 19 11:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:24.077376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991c03-38be-44ec-87c8-442ae565bb30 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.077837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991c03-38be-44ec-87c8-442ae565bb30 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.077941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991c03-38be-44ec-87c8-442ae565bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.097872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7b991c03-38be-44ec-87c8-442ae565bb30 None None] MFA Rules not processed for user `1f1c8f34e83d45c99e25f7fe3711e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:24.099106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7b991c03-38be-44ec-87c8-442ae565bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:24.108910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 698/1411] 10.222.0.35 () {58 vars in 1015 bytes} [Thu May 19 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:24.123291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df729156-1f0b-4b61-8036-2589d3cd2286 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.123572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df729156-1f0b-4b61-8036-2589d3cd2286 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.123841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df729156-1f0b-4b61-8036-2589d3cd2286 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.125262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 714/1412] 10.222.0.35 () {54 vars in 918 bytes} [Thu May 19 11:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:24.131536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6a22-af78-4150-95a1-b8ad5c4d6273 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:24.131816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6a22-af78-4150-95a1-b8ad5c4d6273 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:24.132085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6a22-af78-4150-95a1-b8ad5c4d6273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:24.150898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bf9d6a22-af78-4150-95a1-b8ad5c4d6273 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:24.152526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bf9d6a22-af78-4150-95a1-b8ad5c4d6273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:24.162192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 699/1413] 10.222.0.35 () {58 vars in 1015 bytes} [Thu May 19 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:26.855162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44b98-8866-4d41-bd6b-9f6fed3c3792 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:26.855806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44b98-8866-4d41-bd6b-9f6fed3c3792 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:26.855806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44b98-8866-4d41-bd6b-9f6fed3c3792 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:26.857111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:26.862952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee14f47-d4b3-4620-b49d-3cd62396ec00 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:26.863417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee14f47-d4b3-4620-b49d-3cd62396ec00 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:26.863508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee14f47-d4b3-4620-b49d-3cd62396ec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:26.881848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1ee14f47-d4b3-4620-b49d-3cd62396ec00 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:26.883044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1ee14f47-d4b3-4620-b49d-3cd62396ec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:26.891685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:26.939308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44b98-8866-4d41-bd6b-9f6fed3c3792 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:26.959109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44b98-8866-4d41-bd6b-9f6fed3c3792 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:26.965209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f34e56-a335-4e84-a229-c02552969f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:26.965846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34e56-a335-4e84-a229-c02552969f21 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:26.966188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34e56-a335-4e84-a229-c02552969f21 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:26.966461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34e56-a335-4e84-a229-c02552969f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:26.974948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f34e56-a335-4e84-a229-c02552969f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:26.976535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f34e56-a335-4e84-a229-c02552969f21 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:26.986137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 716/1416] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:27.970212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b9ac-398b-490b-8f4c-3f9029ddb757 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.971130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b9ac-398b-490b-8f4c-3f9029ddb757 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.971130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b9ac-398b-490b-8f4c-3f9029ddb757 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:27.973402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:27.978690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a032b82-126f-427c-8da4-0ed4c86563a9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:27.979148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a032b82-126f-427c-8da4-0ed4c86563a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:27.979253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a032b82-126f-427c-8da4-0ed4c86563a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:27.998923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4a032b82-126f-427c-8da4-0ed4c86563a9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:28.000095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4a032b82-126f-427c-8da4-0ed4c86563a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:28.008275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 11:58:28.178912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b9ac-398b-490b-8f4c-3f9029ddb757 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:28.205206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b9ac-398b-490b-8f4c-3f9029ddb757 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:28.214406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d070a-cb21-4fe0-bea5-2f39c28e6cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:28.215067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d070a-cb21-4fe0-bea5-2f39c28e6cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:28.215345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d070a-cb21-4fe0-bea5-2f39c28e6cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:28.215611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d070a-cb21-4fe0-bea5-2f39c28e6cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:28.227380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d070a-cb21-4fe0-bea5-2f39c28e6cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:28.229076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d070a-cb21-4fe0-bea5-2f39c28e6cf2 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:28.239014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 702/1419] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:29.176841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a429d73-7094-4e6d-a2c5-30bd1bc61ef5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.177437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a429d73-7094-4e6d-a2c5-30bd1bc61ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.177437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a429d73-7094-4e6d-a2c5-30bd1bc61ef5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.179651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:29.187657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c50e7b-a664-44be-b5fa-7675b8f8e06a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.188063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c50e7b-a664-44be-b5fa-7675b8f8e06a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.188277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c50e7b-a664-44be-b5fa-7675b8f8e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.211036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-71c50e7b-a664-44be-b5fa-7675b8f8e06a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:29.212256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-71c50e7b-a664-44be-b5fa-7675b8f8e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:29.223259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:29.373651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a429d73-7094-4e6d-a2c5-30bd1bc61ef5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:29.389320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a429d73-7094-4e6d-a2c5-30bd1bc61ef5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:29.396605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1928a8d-3653-4216-bba6-b37107b8f809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:29.397283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1928a8d-3653-4216-bba6-b37107b8f809 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:29.397562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1928a8d-3653-4216-bba6-b37107b8f809 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:29.397829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1928a8d-3653-4216-bba6-b37107b8f809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:29.407157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1928a8d-3653-4216-bba6-b37107b8f809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:29.408788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1928a8d-3653-4216-bba6-b37107b8f809 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:29.418651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 719/1422] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:30.340191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef5d54-4fcf-4799-ad71-f4c8b61eb45b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.340795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef5d54-4fcf-4799-ad71-f4c8b61eb45b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.340795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef5d54-4fcf-4799-ad71-f4c8b61eb45b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.342145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:30.348192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebbe9-4b74-47bd-b40e-cd194bdb9e54 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.348874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebbe9-4b74-47bd-b40e-cd194bdb9e54 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.349107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebbe9-4b74-47bd-b40e-cd194bdb9e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.375465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5eeebbe9-4b74-47bd-b40e-cd194bdb9e54 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:30.376665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5eeebbe9-4b74-47bd-b40e-cd194bdb9e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:30.385156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:30.532735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef5d54-4fcf-4799-ad71-f4c8b61eb45b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:30.547967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef5d54-4fcf-4799-ad71-f4c8b61eb45b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:30.554228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2346c7-adc9-4cdd-bca8-1b87f5665ba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:30.554854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2346c7-adc9-4cdd-bca8-1b87f5665ba7 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:30.555129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2346c7-adc9-4cdd-bca8-1b87f5665ba7 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:30.555397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2346c7-adc9-4cdd-bca8-1b87f5665ba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:30.564218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2346c7-adc9-4cdd-bca8-1b87f5665ba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:30.565836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2346c7-adc9-4cdd-bca8-1b87f5665ba7 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:30.575595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 705/1425] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:31.531973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020cf27-0ae9-4a3d-8d21-119825c029c9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.532456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020cf27-0ae9-4a3d-8d21-119825c029c9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.532562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020cf27-0ae9-4a3d-8d21-119825c029c9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.533943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:31.539132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f539-8b20-47b2-bc85-4cba1e73f17c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.539593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f539-8b20-47b2-bc85-4cba1e73f17c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.539700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768f539-8b20-47b2-bc85-4cba1e73f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.563127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7768f539-8b20-47b2-bc85-4cba1e73f17c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:31.564918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7768f539-8b20-47b2-bc85-4cba1e73f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:31.576654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:31.725973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020cf27-0ae9-4a3d-8d21-119825c029c9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:31.746977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020cf27-0ae9-4a3d-8d21-119825c029c9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:31.753625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1bcb6-297e-4bb4-a2e3-e56a4392400d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:31.754262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1bcb6-297e-4bb4-a2e3-e56a4392400d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:31.754541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1bcb6-297e-4bb4-a2e3-e56a4392400d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:31.754814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1bcb6-297e-4bb4-a2e3-e56a4392400d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:31.763813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1bcb6-297e-4bb4-a2e3-e56a4392400d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:31.765480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1bcb6-297e-4bb4-a2e3-e56a4392400d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:31.775167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 722/1428] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:32.638207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134af9-1319-4ec4-a1ea-e88d1ecbdfc1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.638795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134af9-1319-4ec4-a1ea-e88d1ecbdfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.638795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134af9-1319-4ec4-a1ea-e88d1ecbdfc1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.640100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:32.645326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3924fe-a73c-47a7-b8af-73cf9a000692 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.645758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3924fe-a73c-47a7-b8af-73cf9a000692 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.645885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3924fe-a73c-47a7-b8af-73cf9a000692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.665535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3e3924fe-a73c-47a7-b8af-73cf9a000692 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:32.666727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e3924fe-a73c-47a7-b8af-73cf9a000692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:32.675325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:32.824444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14134af9-1319-4ec4-a1ea-e88d1ecbdfc1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:32.849597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14134af9-1319-4ec4-a1ea-e88d1ecbdfc1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:32.857802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73050-d7f1-49d1-a4d8-d202f3e1b67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:32.858434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73050-d7f1-49d1-a4d8-d202f3e1b67f service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:32.858708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73050-d7f1-49d1-a4d8-d202f3e1b67f service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:32.858992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73050-d7f1-49d1-a4d8-d202f3e1b67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:32.867645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73050-d7f1-49d1-a4d8-d202f3e1b67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:32.869262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73050-d7f1-49d1-a4d8-d202f3e1b67f service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:32.878689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 708/1431] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:33.742758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b002-87bd-4072-a53a-4bd472f602f4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.743357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b002-87bd-4072-a53a-4bd472f602f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.743357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b002-87bd-4072-a53a-4bd472f602f4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.744760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:33.750976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f6e9-2b7f-42b3-b8ad-ea95e17def72 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.751704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f6e9-2b7f-42b3-b8ad-ea95e17def72 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.751894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f6e9-2b7f-42b3-b8ad-ea95e17def72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.775036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d970f6e9-2b7f-42b3-b8ad-ea95e17def72 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:33.776192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d970f6e9-2b7f-42b3-b8ad-ea95e17def72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:33.785320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:33.934358 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b002-87bd-4072-a53a-4bd472f602f4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:33.950409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b002-87bd-4072-a53a-4bd472f602f4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:33.958038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0866-4a6a-4dae-af6a-7e329e5aa1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:33.958928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0866-4a6a-4dae-af6a-7e329e5aa1a9 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:33.959284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0866-4a6a-4dae-af6a-7e329e5aa1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:33.959638 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0866-4a6a-4dae-af6a-7e329e5aa1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:33.969499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0866-4a6a-4dae-af6a-7e329e5aa1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:33.971084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0866-4a6a-4dae-af6a-7e329e5aa1a9 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:33.980478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 725/1434] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:34.833309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac293-ce57-4f0d-b609-bf60736a2559 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:34.833864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac293-ce57-4f0d-b609-bf60736a2559 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:34.833864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac293-ce57-4f0d-b609-bf60736a2559 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:34.835250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:34.841344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f9b8-2a06-4d77-b5c6-ed29cd4e9e67 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:34.841774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f9b8-2a06-4d77-b5c6-ed29cd4e9e67 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:34.841947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f9b8-2a06-4d77-b5c6-ed29cd4e9e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:34.872067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-10a2f9b8-2a06-4d77-b5c6-ed29cd4e9e67 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:34.873318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-10a2f9b8-2a06-4d77-b5c6-ed29cd4e9e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:34.882774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:35.040888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ac293-ce57-4f0d-b609-bf60736a2559 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:35.057464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ac293-ce57-4f0d-b609-bf60736a2559 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:35.063318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c1226-7071-4e4e-90e6-5f1955776fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:35.063953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c1226-7071-4e4e-90e6-5f1955776fa1 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.064234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c1226-7071-4e4e-90e6-5f1955776fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.064504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c1226-7071-4e4e-90e6-5f1955776fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.072703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c1226-7071-4e4e-90e6-5f1955776fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:35.074291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c1226-7071-4e4e-90e6-5f1955776fa1 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:35.083810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 711/1437] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:35.957376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee3ea2-4869-463e-85e8-bc9a709869b0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.957976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee3ea2-4869-463e-85e8-bc9a709869b0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.957976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee3ea2-4869-463e-85e8-bc9a709869b0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.959315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 11:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:35.964562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d1fae-30b7-4b94-bc18-cd6ece19c7bc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:35.965151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d1fae-30b7-4b94-bc18-cd6ece19c7bc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:35.965468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d1fae-30b7-4b94-bc18-cd6ece19c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:35.990403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e13d1fae-30b7-4b94-bc18-cd6ece19c7bc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:35.991817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e13d1fae-30b7-4b94-bc18-cd6ece19c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:35.999868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:36.150018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee3ea2-4869-463e-85e8-bc9a709869b0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:36.166464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee3ea2-4869-463e-85e8-bc9a709869b0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:36.172235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874a7f-357b-47f6-88e5-ca798918ed3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:36.172911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874a7f-357b-47f6-88e5-ca798918ed3c service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:36.173188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874a7f-357b-47f6-88e5-ca798918ed3c service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:36.173456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874a7f-357b-47f6-88e5-ca798918ed3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:36.182772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874a7f-357b-47f6-88e5-ca798918ed3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:36.184377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874a7f-357b-47f6-88e5-ca798918ed3c service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:36.194703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 728/1440] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:38.265232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd60a-5228-43ce-b38a-901c51c8aea6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.265756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd60a-5228-43ce-b38a-901c51c8aea6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.265866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dd60a-5228-43ce-b38a-901c51c8aea6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.267237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:38.272710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0e43-2f8a-4238-ad04-35098f3d8839 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.273096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0e43-2f8a-4238-ad04-35098f3d8839 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.273261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0e43-2f8a-4238-ad04-35098f3d8839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.291962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e57a0e43-2f8a-4238-ad04-35098f3d8839 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:38.293188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e57a0e43-2f8a-4238-ad04-35098f3d8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:38.303052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:38.341409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dd60a-5228-43ce-b38a-901c51c8aea6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:38.353275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dd60a-5228-43ce-b38a-901c51c8aea6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:38.357263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216138b-f4da-49ff-822d-9b3ebb706671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:38.357890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216138b-f4da-49ff-822d-9b3ebb706671 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:38.358168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216138b-f4da-49ff-822d-9b3ebb706671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:38.358469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216138b-f4da-49ff-822d-9b3ebb706671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:38.367861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216138b-f4da-49ff-822d-9b3ebb706671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:38.369371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216138b-f4da-49ff-822d-9b3ebb706671 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:38.378839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 714/1443] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:40.707582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856fffa-8511-49ea-9b23-126dc82e21c8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.708431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856fffa-8511-49ea-9b23-126dc82e21c8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.708431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856fffa-8511-49ea-9b23-126dc82e21c8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.710627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:40.716195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89a427-fec3-49ae-a535-b09aa17c6bd3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.716688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89a427-fec3-49ae-a535-b09aa17c6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.717122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89a427-fec3-49ae-a535-b09aa17c6bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.737007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fd89a427-fec3-49ae-a535-b09aa17c6bd3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:40.738257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fd89a427-fec3-49ae-a535-b09aa17c6bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:40.749015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:40.794603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856fffa-8511-49ea-9b23-126dc82e21c8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:40.806637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856fffa-8511-49ea-9b23-126dc82e21c8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:40.810585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824234-5a58-4266-8a18-75472fa97dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:40.811502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824234-5a58-4266-8a18-75472fa97dfa service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.811786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824234-5a58-4266-8a18-75472fa97dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.812056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824234-5a58-4266-8a18-75472fa97dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.821194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824234-5a58-4266-8a18-75472fa97dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:40.822971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824234-5a58-4266-8a18-75472fa97dfa service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:40.833289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 731/1446] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:43.449478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de73d-684f-421c-99c5-7cdb8d467c42 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.450322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de73d-684f-421c-99c5-7cdb8d467c42 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.450322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de73d-684f-421c-99c5-7cdb8d467c42 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.452475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:43.458967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ffd38-4e06-466d-81f6-d8181eccc36d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.459399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ffd38-4e06-466d-81f6-d8181eccc36d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.459565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ffd38-4e06-466d-81f6-d8181eccc36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.485797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6a9ffd38-4e06-466d-81f6-d8181eccc36d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:43.486989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6a9ffd38-4e06-466d-81f6-d8181eccc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:43.496111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:43.535460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942de73d-684f-421c-99c5-7cdb8d467c42 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.549907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942de73d-684f-421c-99c5-7cdb8d467c42 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.554203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cac508-fe68-48f8-8dcc-a1d74d48a9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.554869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cac508-fe68-48f8-8dcc-a1d74d48a9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.555150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cac508-fe68-48f8-8dcc-a1d74d48a9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.555464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cac508-fe68-48f8-8dcc-a1d74d48a9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.565384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cac508-fe68-48f8-8dcc-a1d74d48a9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:43.566812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cac508-fe68-48f8-8dcc-a1d74d48a9e7 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:43.576231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 717/1449] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:45.883956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27c5f-ffa5-4a2d-9cc7-f39f8076a54a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.884866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27c5f-ffa5-4a2d-9cc7-f39f8076a54a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.884866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27c5f-ffa5-4a2d-9cc7-f39f8076a54a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:45.887224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:45.893780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06b495-b079-402c-b1fe-f621bed5dab0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.894260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06b495-b079-402c-b1fe-f621bed5dab0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.894362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06b495-b079-402c-b1fe-f621bed5dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:45.915617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9e06b495-b079-402c-b1fe-f621bed5dab0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:45.916854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9e06b495-b079-402c-b1fe-f621bed5dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:45.925245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:45.965980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27c5f-ffa5-4a2d-9cc7-f39f8076a54a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:45.984243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27c5f-ffa5-4a2d-9cc7-f39f8076a54a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:45.990655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1f6ca-3400-4f17-b236-eb08d4d2cfa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:45.991544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f6ca-3400-4f17-b236-eb08d4d2cfa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.991892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f6ca-3400-4f17-b236-eb08d4d2cfa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.992253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f6ca-3400-4f17-b236-eb08d4d2cfa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.002114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1f6ca-3400-4f17-b236-eb08d4d2cfa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:46.003899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1f6ca-3400-4f17-b236-eb08d4d2cfa2 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:46.013422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 734/1452] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:48.271505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad20f-c066-44d2-97dc-b9e4025736ee None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.272094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad20f-c066-44d2-97dc-b9e4025736ee None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.272094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad20f-c066-44d2-97dc-b9e4025736ee None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.273493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:48.279291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c45f8-5a49-4f15-b5bf-d70c206d97da None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.279744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c45f8-5a49-4f15-b5bf-d70c206d97da None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.279849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c45f8-5a49-4f15-b5bf-d70c206d97da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.299295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1c0c45f8-5a49-4f15-b5bf-d70c206d97da None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:48.300498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c0c45f8-5a49-4f15-b5bf-d70c206d97da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:48.311341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:48.349609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aad20f-c066-44d2-97dc-b9e4025736ee None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.367875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aad20f-c066-44d2-97dc-b9e4025736ee None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.372905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912609-42a3-42a8-9a38-8206e5963733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.373570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912609-42a3-42a8-9a38-8206e5963733 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.373851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912609-42a3-42a8-9a38-8206e5963733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.374131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912609-42a3-42a8-9a38-8206e5963733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.383695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a912609-42a3-42a8-9a38-8206e5963733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:48.385206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a912609-42a3-42a8-9a38-8206e5963733 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:48.394660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 720/1455] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:50.653603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565405a-7f83-4460-9347-91dbb901535f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.654479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565405a-7f83-4460-9347-91dbb901535f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.654479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565405a-7f83-4460-9347-91dbb901535f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.656701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:50.666120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655800c3-9656-49e0-8c95-0e59edc186b2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.666573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655800c3-9656-49e0-8c95-0e59edc186b2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.666667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655800c3-9656-49e0-8c95-0e59edc186b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.686171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-655800c3-9656-49e0-8c95-0e59edc186b2 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:50.687355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-655800c3-9656-49e0-8c95-0e59edc186b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:50.696398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 11:58:50.734056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565405a-7f83-4460-9347-91dbb901535f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.747207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565405a-7f83-4460-9347-91dbb901535f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.751353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b633716-096e-45ba-adfd-10d7791f8faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.751993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b633716-096e-45ba-adfd-10d7791f8faa service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.752271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b633716-096e-45ba-adfd-10d7791f8faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.752539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b633716-096e-45ba-adfd-10d7791f8faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.763525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b633716-096e-45ba-adfd-10d7791f8faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.764950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b633716-096e-45ba-adfd-10d7791f8faa service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.774680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 737/1458] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:53.043407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fc2c1-2baf-479c-881d-4bcda1ba6080 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.044315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fc2c1-2baf-479c-881d-4bcda1ba6080 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.044315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fc2c1-2baf-479c-881d-4bcda1ba6080 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.046609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:53.052137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095ea5-1f6b-4c02-b1bd-90e09e4ca015 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.052585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095ea5-1f6b-4c02-b1bd-90e09e4ca015 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.052718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095ea5-1f6b-4c02-b1bd-90e09e4ca015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.072785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-09095ea5-1f6b-4c02-b1bd-90e09e4ca015 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:53.073961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-09095ea5-1f6b-4c02-b1bd-90e09e4ca015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:53.082546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:53.124957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fc2c1-2baf-479c-881d-4bcda1ba6080 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:53.141933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fc2c1-2baf-479c-881d-4bcda1ba6080 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:53.147406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876eff9-4a98-4228-99c3-a9d914c39529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:53.148246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876eff9-4a98-4228-99c3-a9d914c39529 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.148615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876eff9-4a98-4228-99c3-a9d914c39529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.149011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876eff9-4a98-4228-99c3-a9d914c39529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.161847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876eff9-4a98-4228-99c3-a9d914c39529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:53.165884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876eff9-4a98-4228-99c3-a9d914c39529 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:53.176230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 723/1461] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:55.449534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c76a6-5079-45e0-bd06-21d41760699e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.450472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c76a6-5079-45e0-bd06-21d41760699e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.450472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c76a6-5079-45e0-bd06-21d41760699e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.452889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:55.459232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14405-d795-406f-b599-efeeebf9f539 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.459680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14405-d795-406f-b599-efeeebf9f539 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.459782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14405-d795-406f-b599-efeeebf9f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.469535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=79 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:55.485952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5ef14405-d795-406f-b599-efeeebf9f539 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:55.487167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5ef14405-d795-406f-b599-efeeebf9f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:55.495218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 11:58:55.532833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c76a6-5079-45e0-bd06-21d41760699e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:55.541589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=73 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:55.548662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c76a6-5079-45e0-bd06-21d41760699e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:55.552664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dfe36-b225-4d7b-89bf-3d10a26ca249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:55.553318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dfe36-b225-4d7b-89bf-3d10a26ca249 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.553597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dfe36-b225-4d7b-89bf-3d10a26ca249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.553869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dfe36-b225-4d7b-89bf-3d10a26ca249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.563669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dfe36-b225-4d7b-89bf-3d10a26ca249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:55.565165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dfe36-b225-4d7b-89bf-3d10a26ca249 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:55.574662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 740/1464] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:58:57.802533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271961-4600-4697-bc63-ced4d6948756 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.803385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271961-4600-4697-bc63-ced4d6948756 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.803385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271961-4600-4697-bc63-ced4d6948756 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.805544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:57.811832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70909ce2-3090-431f-94a8-16e088ca30d9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.812285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70909ce2-3090-431f-94a8-16e088ca30d9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.812391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70909ce2-3090-431f-94a8-16e088ca30d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.831600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-70909ce2-3090-431f-94a8-16e088ca30d9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:57.832811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-70909ce2-3090-431f-94a8-16e088ca30d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:57.841399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:58:57.881838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271961-4600-4697-bc63-ced4d6948756 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:57.899370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271961-4600-4697-bc63-ced4d6948756 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:57.903847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d22a6-c212-4eed-bd72-cdd75e209cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:57.904475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d22a6-c212-4eed-bd72-cdd75e209cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.904775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d22a6-c212-4eed-bd72-cdd75e209cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.905044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d22a6-c212-4eed-bd72-cdd75e209cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.914607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d22a6-c212-4eed-bd72-cdd75e209cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:57.916030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d22a6-c212-4eed-bd72-cdd75e209cb8 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:57.925368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 726/1467] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:59:00.118788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc446-b6c4-4e31-8ff2-6e6605147625 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.119417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc446-b6c4-4e31-8ff2-6e6605147625 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.119417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc446-b6c4-4e31-8ff2-6e6605147625 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.120788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 11:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:00.127151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f6457-397a-4f62-ab11-796220be934b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.127887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f6457-397a-4f62-ab11-796220be934b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.128010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f6457-397a-4f62-ab11-796220be934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.154552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eb8f6457-397a-4f62-ab11-796220be934b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:00.155742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eb8f6457-397a-4f62-ab11-796220be934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:00.164190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:00.199422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc446-b6c4-4e31-8ff2-6e6605147625 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.211988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc446-b6c4-4e31-8ff2-6e6605147625 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.216055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7dda8-b451-4344-8bb3-504de9e84b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.216675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7dda8-b451-4344-8bb3-504de9e84b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.216976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7dda8-b451-4344-8bb3-504de9e84b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.217246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7dda8-b451-4344-8bb3-504de9e84b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.226139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7dda8-b451-4344-8bb3-504de9e84b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.227609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7dda8-b451-4344-8bb3-504de9e84b0c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.237203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 743/1470] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 11:59:10.147404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=11 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:10.232847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=14 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:32.858317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8e2f7-a45c-4386-90aa-edf310f932ea None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.859172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8e2f7-a45c-4386-90aa-edf310f932ea None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.859172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8e2f7-a45c-4386-90aa-edf310f932ea None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.861431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 728/1471] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:59:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:32.869962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf425a-6d4a-4c24-bc33-e55c8f64bbf8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.870413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf425a-6d4a-4c24-bc33-e55c8f64bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.870570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf425a-6d4a-4c24-bc33-e55c8f64bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.896571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-32cf425a-6d4a-4c24-bc33-e55c8f64bbf8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:32.897798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-32cf425a-6d4a-4c24-bc33-e55c8f64bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:32.910694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 744/1472] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:32.962834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9468f-08aa-425c-bbce-4c28d8b51ecd None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.963120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9468f-08aa-425c-bbce-4c28d8b51ecd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.963918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9468f-08aa-425c-bbce-4c28d8b51ecd None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.964856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 729/1473] 10.222.0.35 () {54 vars in 962 bytes} [Thu May 19 11:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:32.970007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a402-3fda-4240-9817-8266ba591f75 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:32.970296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a402-3fda-4240-9817-8266ba591f75 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:32.970569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71a402-3fda-4240-9817-8266ba591f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:32.990443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0e71a402-3fda-4240-9817-8266ba591f75 None None] MFA Rules not processed for user `9f1470011d984f45be788072525f82cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:32.991633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0e71a402-3fda-4240-9817-8266ba591f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:32.998612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 745/1474] 10.222.0.35 () {58 vars in 1059 bytes} [Thu May 19 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:33.005865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9468f-08aa-425c-bbce-4c28d8b51ecd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:33.017824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9468f-08aa-425c-bbce-4c28d8b51ecd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:33.021948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f85c3-db3b-4cb3-aa41-e9e8203049df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1470011d984f45be788072525f82cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:33.022571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f85c3-db3b-4cb3-aa41-e9e8203049df service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:33.022852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f85c3-db3b-4cb3-aa41-e9e8203049df service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:33.023121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f85c3-db3b-4cb3-aa41-e9e8203049df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:33.033257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f85c3-db3b-4cb3-aa41-e9e8203049df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:33.034703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f85c3-db3b-4cb3-aa41-e9e8203049df service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:33.044278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 730/1475] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:59:35.316011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf9bd-ea66-445c-8bc6-d236e139ebc3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.316617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf9bd-ea66-445c-8bc6-d236e139ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.316617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf9bd-ea66-445c-8bc6-d236e139ebc3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.317964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 746/1476] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:35.324382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a81c1d-e6ab-4f21-a76e-c9cc0cc871ae None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.324873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a81c1d-e6ab-4f21-a76e-c9cc0cc871ae None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.325005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a81c1d-e6ab-4f21-a76e-c9cc0cc871ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.348825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-92a81c1d-e6ab-4f21-a76e-c9cc0cc871ae None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:35.350020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-92a81c1d-e6ab-4f21-a76e-c9cc0cc871ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:35.358654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 731/1477] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:35.381643 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cf9bd-ea66-445c-8bc6-d236e139ebc3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:35.396132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cf9bd-ea66-445c-8bc6-d236e139ebc3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:35.401642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa3836-c5c9-49de-965f-f5b12f014df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:35.402632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa3836-c5c9-49de-965f-f5b12f014df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:35.402913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa3836-c5c9-49de-965f-f5b12f014df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:35.403148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa3836-c5c9-49de-965f-f5b12f014df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:35.403918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa3836-c5c9-49de-965f-f5b12f014df4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:35.405791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-8daa3836-c5c9-49de-965f-f5b12f014df4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 11:59:35.405791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 11:59:35.405791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 11:59:35.406949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa3836-c5c9-49de-965f-f5b12f014df4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:35.426244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 747/1478] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 11:59:35 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 11:59:37.627888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee040c2-b7be-45c6-96f4-8f13bd05db64 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:37.628802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee040c2-b7be-45c6-96f4-8f13bd05db64 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:37.628802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee040c2-b7be-45c6-96f4-8f13bd05db64 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:37.631036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 732/1479] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:59:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:37.637352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab160bc8-d122-44ec-b51a-c9aa46ade24c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:37.638077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab160bc8-d122-44ec-b51a-c9aa46ade24c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:37.638236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab160bc8-d122-44ec-b51a-c9aa46ade24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:37.663401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ab160bc8-d122-44ec-b51a-c9aa46ade24c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:37.664912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ab160bc8-d122-44ec-b51a-c9aa46ade24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:37.673497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 748/1480] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:37.728047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee040c2-b7be-45c6-96f4-8f13bd05db64 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:37.743659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee040c2-b7be-45c6-96f4-8f13bd05db64 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:37.749818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a116d65-2911-48d3-8a09-088b22238c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:37.750440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a116d65-2911-48d3-8a09-088b22238c8b service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:37.750717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a116d65-2911-48d3-8a09-088b22238c8b service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:37.750984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a116d65-2911-48d3-8a09-088b22238c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:37.759510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a116d65-2911-48d3-8a09-088b22238c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:37.761060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a116d65-2911-48d3-8a09-088b22238c8b service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:37.770942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 733/1481] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:59:40.191908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e10b4f-6296-4580-8885-49704bdc7a9a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:40.192798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e10b4f-6296-4580-8885-49704bdc7a9a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:40.192798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e10b4f-6296-4580-8885-49704bdc7a9a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:40.194962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 749/1482] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:40.203415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c1d87-737f-40b1-9bdc-197a706eefeb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:40.203863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c1d87-737f-40b1-9bdc-197a706eefeb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:40.203966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c1d87-737f-40b1-9bdc-197a706eefeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:40.225000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d49c1d87-737f-40b1-9bdc-197a706eefeb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:40.226181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d49c1d87-737f-40b1-9bdc-197a706eefeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:40.235368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 734/1483] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:40.270668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e10b4f-6296-4580-8885-49704bdc7a9a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:40.282532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e10b4f-6296-4580-8885-49704bdc7a9a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:40.286199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2d1c-1821-4942-8bb5-9c611f1e86b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:40.286861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2d1c-1821-4942-8bb5-9c611f1e86b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:40.287140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2d1c-1821-4942-8bb5-9c611f1e86b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:40.287413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2d1c-1821-4942-8bb5-9c611f1e86b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:40.296546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2d1c-1821-4942-8bb5-9c611f1e86b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:40.298047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2d1c-1821-4942-8bb5-9c611f1e86b3 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:40.307645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 750/1484] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:59:42.604437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b5a07-f855-4504-bd9b-1ef7866e1d2c None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:42.605137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b5a07-f855-4504-bd9b-1ef7866e1d2c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:42.605137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b5a07-f855-4504-bd9b-1ef7866e1d2c None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:42.606408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 735/1485] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:42.612157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038a44-e195-4b28-8f50-826fa939e8a9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:42.612669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038a44-e195-4b28-8f50-826fa939e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:42.612769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d038a44-e195-4b28-8f50-826fa939e8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:42.632291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9d038a44-e195-4b28-8f50-826fa939e8a9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:42.633566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9d038a44-e195-4b28-8f50-826fa939e8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:42.643103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 751/1486] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:42.680673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b5a07-f855-4504-bd9b-1ef7866e1d2c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:42.694141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b5a07-f855-4504-bd9b-1ef7866e1d2c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:42.699025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1de3a-3ea7-4d33-a146-844fbf66b365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:42.699671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1de3a-3ea7-4d33-a146-844fbf66b365 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:42.699980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1de3a-3ea7-4d33-a146-844fbf66b365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:42.700329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1de3a-3ea7-4d33-a146-844fbf66b365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:42.709939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1de3a-3ea7-4d33-a146-844fbf66b365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:42.711392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1de3a-3ea7-4d33-a146-844fbf66b365 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:42.720943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 736/1487] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 11:59:45.035073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503432-ce4e-434a-bb41-43b639a7fbf8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:45.035690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503432-ce4e-434a-bb41-43b639a7fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:45.035690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503432-ce4e-434a-bb41-43b639a7fbf8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:45.037657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 752/1488] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:45.044066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7688-ee27-4570-b124-e7f1a25ac790 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:45.044529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7688-ee27-4570-b124-e7f1a25ac790 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:45.044529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7688-ee27-4570-b124-e7f1a25ac790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:45.067764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2b9e7688-ee27-4570-b124-e7f1a25ac790 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:45.068980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2b9e7688-ee27-4570-b124-e7f1a25ac790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:45.077973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 737/1489] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:45.124355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2503432-ce4e-434a-bb41-43b639a7fbf8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:45.136313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2503432-ce4e-434a-bb41-43b639a7fbf8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:45.140227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3b0f2-c386-43af-b250-1d6674b9934f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:45.141008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b0f2-c386-43af-b250-1d6674b9934f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:45.141343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b0f2-c386-43af-b250-1d6674b9934f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:45.141665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b0f2-c386-43af-b250-1d6674b9934f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:45.150748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b0f2-c386-43af-b250-1d6674b9934f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:45.152550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b0f2-c386-43af-b250-1d6674b9934f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:45.162014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 753/1490] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:59:47.572922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2492-17e3-4edf-a09a-b59e269bdd86 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:47.573807 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2492-17e3-4edf-a09a-b59e269bdd86 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:47.573807 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2492-17e3-4edf-a09a-b59e269bdd86 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:47.576011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 738/1491] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 11:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:47.581679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a29ef-1b8a-4e5b-96d6-f84555ab3f38 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:47.582118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a29ef-1b8a-4e5b-96d6-f84555ab3f38 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:47.582223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a29ef-1b8a-4e5b-96d6-f84555ab3f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:47.603072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-398a29ef-1b8a-4e5b-96d6-f84555ab3f38 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:47.604273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-398a29ef-1b8a-4e5b-96d6-f84555ab3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:47.612626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 754/1492] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 11:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 11:59:47.651056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2492-17e3-4edf-a09a-b59e269bdd86 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:47.665177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2492-17e3-4edf-a09a-b59e269bdd86 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:47.670024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c1ba-7aaf-4462-8b31-8f7a15e06376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:47.670666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c1ba-7aaf-4462-8b31-8f7a15e06376 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:47.670987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c1ba-7aaf-4462-8b31-8f7a15e06376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:47.671252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c1ba-7aaf-4462-8b31-8f7a15e06376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:47.680524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c1ba-7aaf-4462-8b31-8f7a15e06376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:47.681994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c1ba-7aaf-4462-8b31-8f7a15e06376 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:47.691433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 739/1493] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 11:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 11:59:57.598121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:57.687156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=33 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:34.030947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291241-3ea4-40cc-99db-140589f9b56f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.031807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291241-3ea4-40cc-99db-140589f9b56f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.031807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291241-3ea4-40cc-99db-140589f9b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.051970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-51291241-3ea4-40cc-99db-140589f9b56f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:34.053186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-51291241-3ea4-40cc-99db-140589f9b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:34.065211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 755/1494] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:34.074549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a37e3-3f2b-4c5d-b336-5e557dbc62de None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.075119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a37e3-3f2b-4c5d-b336-5e557dbc62de None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.075119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a37e3-3f2b-4c5d-b336-5e557dbc62de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.094353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-020a37e3-3f2b-4c5d-b336-5e557dbc62de None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:34.095567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-020a37e3-3f2b-4c5d-b336-5e557dbc62de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:34.104424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 740/1495] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:34.109297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291241-3ea4-40cc-99db-140589f9b56f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.119499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291241-3ea4-40cc-99db-140589f9b56f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.125398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.126065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.126325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.126596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.127329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:01:34.127631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.128706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:34.128706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 12:01:34.128706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 12:01:34.129612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.142006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 756/1496] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:01:34.150160 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a37e3-3f2b-4c5d-b336-5e557dbc62de None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.160181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a37e3-3f2b-4c5d-b336-5e557dbc62de None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.166031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.166671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.166952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.167211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.167887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.169685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:34.169685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: warnings.warn(msg) May 19 12:01:34.169685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: May 19 12:01:34.170924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.220603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 741/1497] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:01:34.225325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.238594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b082e-5388-41da-a191-b3a775e13929 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.303165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.303745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.304024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.304298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.305018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.306062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:34.306062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 12:01:34.306062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 12:01:34.307250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.329942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 757/1498] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:01:34.334162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.344529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce501082-1857-440c-873a-819c97612b67 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.349489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.350151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.350428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.350695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.351423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.352439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:34.352439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: warnings.warn(msg) May 19 12:01:34.352439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: May 19 12:01:34.353374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.366672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 742/1499] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:01:34.370944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.381152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20322-cff2-42ec-b77b-20d4f11e640a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.386899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae4cde-0a5d-43c1-963f-323e94333037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.387551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae4cde-0a5d-43c1-963f-323e94333037 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.387829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae4cde-0a5d-43c1-963f-323e94333037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.388092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae4cde-0a5d-43c1-963f-323e94333037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.388841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae4cde-0a5d-43c1-963f-323e94333037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.389862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-90ae4cde-0a5d-43c1-963f-323e94333037 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:34.389862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 12:01:34.389862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 12:01:34.390803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae4cde-0a5d-43c1-963f-323e94333037 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.404383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 758/1500] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:01:34.408543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.418725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174bf7-6d8d-492b-91ef-d8165915bbdc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.424616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e29a64-ddcd-4336-a875-cc0099e81b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.425559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e29a64-ddcd-4336-a875-cc0099e81b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.425835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e29a64-ddcd-4336-a875-cc0099e81b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.426107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e29a64-ddcd-4336-a875-cc0099e81b36 admin admin] PATH_INFO: `/v3/projects/9c51542c4c9347f689e66d151b7a8770/users/464569917e5847a786a92f882eb33907/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.444484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e29a64-ddcd-4336-a875-cc0099e81b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c51542c4c9347f689e66d151b7a8770, user_id=464569917e5847a786a92f882eb33907, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.445545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-80e29a64-ddcd-4336-a875-cc0099e81b36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:34.445545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: warnings.warn(msg) May 19 12:01:34.445545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: May 19 12:01:34.447645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e29a64-ddcd-4336-a875-cc0099e81b36 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.464104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 743/1501] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:01:34 2022] PUT /identity/v3/projects/9c51542c4c9347f689e66d151b7a8770/users/464569917e5847a786a92f882eb33907/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:01:34.475698 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955fb94-4cce-4a04-89e4-8d16261ab2b8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.475982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955fb94-4cce-4a04-89e4-8d16261ab2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.476277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955fb94-4cce-4a04-89e4-8d16261ab2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.506014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f955fb94-4cce-4a04-89e4-8d16261ab2b8 None None] MFA Rules not processed for user `464569917e5847a786a92f882eb33907`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:34.507005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f955fb94-4cce-4a04-89e4-8d16261ab2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:34.575635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 759/1502] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:34.589155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e0ca0-4781-496b-99c5-c707daf546d1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.589440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e0ca0-4781-496b-99c5-c707daf546d1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.589708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e0ca0-4781-496b-99c5-c707daf546d1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.591117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 744/1503] 10.222.0.35 () {54 vars in 963 bytes} [Thu May 19 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:34.595983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214578e2-7b19-4ae1-bbfc-2ee04a01f3bf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.596269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214578e2-7b19-4ae1-bbfc-2ee04a01f3bf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.596541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214578e2-7b19-4ae1-bbfc-2ee04a01f3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.614360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-214578e2-7b19-4ae1-bbfc-2ee04a01f3bf None None] MFA Rules not processed for user `8935a1ea9f94443f903d479401706473`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:34.615558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-214578e2-7b19-4ae1-bbfc-2ee04a01f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:34.671485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:34.681036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 760/1504] 10.222.0.35 () {58 vars in 1060 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:01:34.689096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e0ca0-4781-496b-99c5-c707daf546d1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.700019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e0ca0-4781-496b-99c5-c707daf546d1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.703739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.704374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.704665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.704958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.713319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.714751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.723699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 745/1505] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:01:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:34.773890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375367e-778f-4378-bc9f-9f9112200151 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.774209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375367e-778f-4378-bc9f-9f9112200151 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.774481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375367e-778f-4378-bc9f-9f9112200151 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.776168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 761/1506] 10.222.0.35 () {52 vars in 829 bytes} [Thu May 19 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:34.779981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.844371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1e57-dd0a-47b6-a30c-4ea594926a4f service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.849981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.850845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.851128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.851392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] PATH_INFO: `/v3/users/464569917e5847a786a92f882eb33907` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.852721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=464569917e5847a786a92f882eb33907)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.853716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:34.853716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: warnings.warn(msg) May 19 12:01:34.853716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: May 19 12:01:34.854957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.922089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464569917e5847a786a92f882eb33907'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:34.922832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464569917e5847a786a92f882eb33907'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:34.923470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464569917e5847a786a92f882eb33907'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:34.934728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464569917e5847a786a92f882eb33907'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:34.952616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464569917e5847a786a92f882eb33907'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:34.961377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:34.973413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 746/1507] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:01:34 2022] DELETE /identity/v3/users/464569917e5847a786a92f882eb33907 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:01:34.977953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.978245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.978520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:35.127311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:35.128439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:35.188966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 762/1508] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:35.199563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:35.201197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:35.265679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2124651-5a83-426e-99ae-830171b1afbc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:35.269373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc2a8-86fb-44fd-b1e2-b58fa1837b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:35.270014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc2a8-86fb-44fd-b1e2-b58fa1837b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:35.270289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc2a8-86fb-44fd-b1e2-b58fa1837b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:35.270557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc2a8-86fb-44fd-b1e2-b58fa1837b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:35.280100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc2a8-86fb-44fd-b1e2-b58fa1837b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:35.282043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc2a8-86fb-44fd-b1e2-b58fa1837b65 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:35.292478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 747/1509] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:35.640814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:35.642488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:35.654953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69debdc-756e-4dcc-92c3-e564ff837a9e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:35.660456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:35.661368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:35.661657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:35.661912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] PATH_INFO: `/v3/projects/9c51542c4c9347f689e66d151b7a8770` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:35.663102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c51542c4c9347f689e66d151b7a8770)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:35.664132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:01:35.664132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 12:01:35.664132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 12:01:35.665371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:35.732397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c51542c4c9347f689e66d151b7a8770', 'request_id': 'req-5d7b57a0-6f31-40c3-8380-cc67551971e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:35.738528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c51542c4c9347f689e66d151b7a8770', 'request_id': 'req-5d7b57a0-6f31-40c3-8380-cc67551971e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:35.751548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c51542c4c9347f689e66d151b7a8770', 'request_id': 'req-5d7b57a0-6f31-40c3-8380-cc67551971e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:35.768766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] The token cache is being invalidate because project 9c51542c4c9347f689e66d151b7a8770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:01:35.769057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:35.769785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5d7b57a0-6f31-40c3-8380-cc67551971e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:01:35.771366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 763/1510] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:01:35 2022] DELETE /identity/v3/projects/9c51542c4c9347f689e66d151b7a8770 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:01:45.288133 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=29 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:45.765475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:03:18.949656 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b416f3-c4a4-43e7-9a94-4eac396321bc None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:18.950282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b416f3-c4a4-43e7-9a94-4eac396321bc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:18.950282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b416f3-c4a4-43e7-9a94-4eac396321bc None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:18.951595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:03:18.957669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504236d-47a3-4209-a380-6c0dbaf62afa None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:18.958213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504236d-47a3-4209-a380-6c0dbaf62afa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:18.958396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504236d-47a3-4209-a380-6c0dbaf62afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:18.977226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0504236d-47a3-4209-a380-6c0dbaf62afa None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:18.978419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0504236d-47a3-4209-a380-6c0dbaf62afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:19.049662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:19.231927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b416f3-c4a4-43e7-9a94-4eac396321bc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:19.234980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-29b416f3-c4a4-43e7-9a94-4eac396321bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:19.319446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b416f3-c4a4-43e7-9a94-4eac396321bc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:19.326055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbc814-688c-49a7-ac4e-ff92dce97364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:19.326701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc814-688c-49a7-ac4e-ff92dce97364 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:19.326980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc814-688c-49a7-ac4e-ff92dce97364 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:19.327251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbc814-688c-49a7-ac4e-ff92dce97364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:19.335888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbc814-688c-49a7-ac4e-ff92dce97364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:19.337504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbc814-688c-49a7-ac4e-ff92dce97364 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:19.347077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 749/1513] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:19.957211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef941d4-e442-4aa2-bfb0-c486c8221477 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:19.957608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef941d4-e442-4aa2-bfb0-c486c8221477 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:19.958020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef941d4-e442-4aa2-bfb0-c486c8221477 None None] PATH_INFO: `/v3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:19.959447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 765/1514] 10.222.0.86 () {54 vars in 925 bytes} [Thu May 19 12:03:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:03:19.965959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5eb15-6fa4-4bbc-a591-cd5d9a919d1d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:19.966420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5eb15-6fa4-4bbc-a591-cd5d9a919d1d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:19.966537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5eb15-6fa4-4bbc-a591-cd5d9a919d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:19.986320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b9a5eb15-6fa4-4bbc-a591-cd5d9a919d1d None None] MFA Rules not processed for user `1f1c8f34e83d45c99e25f7fe3711e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:19.987528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b9a5eb15-6fa4-4bbc-a591-cd5d9a919d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:20.056406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 750/1515] 10.222.0.86 () {58 vars in 1015 bytes} [Thu May 19 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:20.264549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ad76-8de9-4355-8b50-63c145ed8070 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:20.264870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ad76-8de9-4355-8b50-63c145ed8070 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:20.265211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ad76-8de9-4355-8b50-63c145ed8070 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:20.267077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 766/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:20.275198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ced5-5600-48a7-8208-956534ed611d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:20.275748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ced5-5600-48a7-8208-956534ed611d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:20.276057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ced5-5600-48a7-8208-956534ed611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:20.299766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-17e1ced5-5600-48a7-8208-956534ed611d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:20.301010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-17e1ced5-5600-48a7-8208-956534ed611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:20.310102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 751/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:20.462054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ad76-8de9-4355-8b50-63c145ed8070 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:20.479270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ad76-8de9-4355-8b50-63c145ed8070 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:20.487884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86557a-5acc-4caa-b3af-3113c3bd051f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:20.488847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86557a-5acc-4caa-b3af-3113c3bd051f service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:20.489190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86557a-5acc-4caa-b3af-3113c3bd051f service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:20.489461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86557a-5acc-4caa-b3af-3113c3bd051f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:20.498209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86557a-5acc-4caa-b3af-3113c3bd051f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:20.499854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86557a-5acc-4caa-b3af-3113c3bd051f service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:20.510253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 767/1518] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:29.153370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d279140-f94b-499d-ba37-17ef23ffb090 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:29.153875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d279140-f94b-499d-ba37-17ef23ffb090 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:29.153875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d279140-f94b-499d-ba37-17ef23ffb090 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:29.155296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 752/1519] 10.222.0.35 () {54 vars in 960 bytes} [Thu May 19 12:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:29.161551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8b83f-791f-437f-a688-915e91aa3008 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:29.162344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8b83f-791f-437f-a688-915e91aa3008 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:29.162474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8b83f-791f-437f-a688-915e91aa3008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:29.182278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-74a8b83f-791f-437f-a688-915e91aa3008 None None] MFA Rules not processed for user `1f1c8f34e83d45c99e25f7fe3711e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:29.183486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74a8b83f-791f-437f-a688-915e91aa3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:29.193731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 768/1520] 10.222.0.35 () {58 vars in 1057 bytes} [Thu May 19 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:29.205336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d279140-f94b-499d-ba37-17ef23ffb090 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:29.227044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d279140-f94b-499d-ba37-17ef23ffb090 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:29.233599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb3008-d7e2-4c4c-8f34-aea4494f8f12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:29.234247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb3008-d7e2-4c4c-8f34-aea4494f8f12 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:29.234508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb3008-d7e2-4c4c-8f34-aea4494f8f12 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:29.234843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb3008-d7e2-4c4c-8f34-aea4494f8f12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:29.244004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb3008-d7e2-4c4c-8f34-aea4494f8f12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:29.245662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb3008-d7e2-4c4c-8f34-aea4494f8f12 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:29.255806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 753/1521] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:31.848972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3150-ba0b-4266-b1e7-d9b7271c3689 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:31.849560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3150-ba0b-4266-b1e7-d9b7271c3689 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:31.849560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3150-ba0b-4266-b1e7-d9b7271c3689 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:31.851630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:31.859007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf129f-3b9b-4c60-8b19-7752c240d53c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:31.859498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf129f-3b9b-4c60-8b19-7752c240d53c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:31.859498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf129f-3b9b-4c60-8b19-7752c240d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:31.878412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9bbf129f-3b9b-4c60-8b19-7752c240d53c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:31.879637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9bbf129f-3b9b-4c60-8b19-7752c240d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:31.887887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:03:32.044423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3150-ba0b-4266-b1e7-d9b7271c3689 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:32.063173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3150-ba0b-4266-b1e7-d9b7271c3689 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:32.069346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74765af5-87a2-4403-a656-6b17a1b74a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:32.069979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74765af5-87a2-4403-a656-6b17a1b74a70 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:32.070259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74765af5-87a2-4403-a656-6b17a1b74a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:32.070535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74765af5-87a2-4403-a656-6b17a1b74a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:32.078922 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74765af5-87a2-4403-a656-6b17a1b74a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:32.080517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74765af5-87a2-4403-a656-6b17a1b74a70 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:32.091989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 770/1524] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:32.992844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055b70-7eaf-4426-9536-51602c98b19f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:32.993470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055b70-7eaf-4426-9536-51602c98b19f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:32.993470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055b70-7eaf-4426-9536-51602c98b19f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:32.994911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:33.000630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3376-ee41-45f5-9553-6f9e22906447 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:33.001391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3376-ee41-45f5-9553-6f9e22906447 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:33.001529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3376-ee41-45f5-9553-6f9e22906447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:33.022469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-47dd3376-ee41-45f5-9553-6f9e22906447 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:33.023673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-47dd3376-ee41-45f5-9553-6f9e22906447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:33.032163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:33.187058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6055b70-7eaf-4426-9536-51602c98b19f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:33.210313 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6055b70-7eaf-4426-9536-51602c98b19f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:33.216090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea64943-a68e-4ca9-87d8-bb5b456c505d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:33.216766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64943-a68e-4ca9-87d8-bb5b456c505d service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:33.217022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64943-a68e-4ca9-87d8-bb5b456c505d service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:33.217285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea64943-a68e-4ca9-87d8-bb5b456c505d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:33.225661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea64943-a68e-4ca9-87d8-bb5b456c505d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:33.227241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea64943-a68e-4ca9-87d8-bb5b456c505d service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:33.237009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 756/1527] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:37.319642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb55d9-050c-4854-a324-850b6f6f4a2b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:37.320229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb55d9-050c-4854-a324-850b6f6f4a2b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:37.320229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb55d9-050c-4854-a324-850b6f6f4a2b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:37.321604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:37.327864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620ec9-95ff-4943-96b0-0328cb16c77b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:37.328603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620ec9-95ff-4943-96b0-0328cb16c77b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:37.328827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620ec9-95ff-4943-96b0-0328cb16c77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:37.355126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-84620ec9-95ff-4943-96b0-0328cb16c77b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:37.356337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-84620ec9-95ff-4943-96b0-0328cb16c77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:37.364671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:37.401088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb55d9-050c-4854-a324-850b6f6f4a2b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:37.402982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7fcb55d9-050c-4854-a324-850b6f6f4a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:37.462222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb55d9-050c-4854-a324-850b6f6f4a2b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:37.465843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2c96a-a9ae-4012-a65c-14d76826da76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:37.466496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2c96a-a9ae-4012-a65c-14d76826da76 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:37.466769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2c96a-a9ae-4012-a65c-14d76826da76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:37.467034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2c96a-a9ae-4012-a65c-14d76826da76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:37.476371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2c96a-a9ae-4012-a65c-14d76826da76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:37.477844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2c96a-a9ae-4012-a65c-14d76826da76 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:37.487571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 773/1530] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:39.675087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985202-86dc-4723-a428-0fdb745198a5 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:39.675974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985202-86dc-4723-a428-0fdb745198a5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:39.675974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985202-86dc-4723-a428-0fdb745198a5 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:39.678269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:03:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:39.684534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43dc29-40a4-4d5c-a074-cc0000e38fc3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:39.685001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43dc29-40a4-4d5c-a074-cc0000e38fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:39.685115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43dc29-40a4-4d5c-a074-cc0000e38fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:39.706933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9f43dc29-40a4-4d5c-a074-cc0000e38fc3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:39.708142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9f43dc29-40a4-4d5c-a074-cc0000e38fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:39.716576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:39.752207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985202-86dc-4723-a428-0fdb745198a5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:39.754229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6c985202-86dc-4723-a428-0fdb745198a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:39.769004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985202-86dc-4723-a428-0fdb745198a5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:39.773299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eda53-4ff6-4aa8-8193-87f8ffd6f7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:39.774951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eda53-4ff6-4aa8-8193-87f8ffd6f7dd service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:39.776695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eda53-4ff6-4aa8-8193-87f8ffd6f7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:39.776981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eda53-4ff6-4aa8-8193-87f8ffd6f7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:39.788326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eda53-4ff6-4aa8-8193-87f8ffd6f7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:39.789816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eda53-4ff6-4aa8-8193-87f8ffd6f7dd service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:39.799744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 759/1533] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:43.586035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aceff-a66a-44ef-9cbd-49f06b7c94ad None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:43.586577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aceff-a66a-44ef-9cbd-49f06b7c94ad None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:43.586577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aceff-a66a-44ef-9cbd-49f06b7c94ad None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:43.588758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:03:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:43.597736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ccb4-e04c-4ef7-ac79-e17669d93edc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:43.598145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ccb4-e04c-4ef7-ac79-e17669d93edc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:43.598322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ccb4-e04c-4ef7-ac79-e17669d93edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:43.618401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d071ccb4-e04c-4ef7-ac79-e17669d93edc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:43.619593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d071ccb4-e04c-4ef7-ac79-e17669d93edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:43.628208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:43.896925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aceff-a66a-44ef-9cbd-49f06b7c94ad None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:43.900575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f7aceff-a66a-44ef-9cbd-49f06b7c94ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:43.975822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aceff-a66a-44ef-9cbd-49f06b7c94ad None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:43.980296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8b7c9-2e23-4af5-a5e2-b5b57e4ed4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:43.980962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8b7c9-2e23-4af5-a5e2-b5b57e4ed4af service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:43.981237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8b7c9-2e23-4af5-a5e2-b5b57e4ed4af service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:43.981497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8b7c9-2e23-4af5-a5e2-b5b57e4ed4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:43.991494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8b7c9-2e23-4af5-a5e2-b5b57e4ed4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:43.992965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8b7c9-2e23-4af5-a5e2-b5b57e4ed4af service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:43.997958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:03:44.003151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 776/1536] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:46.237507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872371-7e89-492f-baeb-f47c559c3423 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:46.238433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872371-7e89-492f-baeb-f47c559c3423 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:46.238433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872371-7e89-492f-baeb-f47c559c3423 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:46.240451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:03:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:46.246829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977197-db65-4cbe-a6fe-5047625791e0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:46.247254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977197-db65-4cbe-a6fe-5047625791e0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:46.247422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977197-db65-4cbe-a6fe-5047625791e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:46.268757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-60977197-db65-4cbe-a6fe-5047625791e0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:46.269958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-60977197-db65-4cbe-a6fe-5047625791e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:46.278599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:46.551604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872371-7e89-492f-baeb-f47c559c3423 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:46.554840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-13872371-7e89-492f-baeb-f47c559c3423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:46.568427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:03:46.575430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872371-7e89-492f-baeb-f47c559c3423 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:46.579322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a8f0b-ee55-4353-91ca-f1beb38da4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:46.579957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a8f0b-ee55-4353-91ca-f1beb38da4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:46.580233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a8f0b-ee55-4353-91ca-f1beb38da4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:46.580499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a8f0b-ee55-4353-91ca-f1beb38da4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:46.590135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a8f0b-ee55-4353-91ca-f1beb38da4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:46.591557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a8f0b-ee55-4353-91ca-f1beb38da4e3 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:46.601089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 762/1539] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:56.263627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:03:56.597039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:16.592495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6683f-5250-4f92-8628-c8460ddd733d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.593500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6683f-5250-4f92-8628-c8460ddd733d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.593947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6683f-5250-4f92-8628-c8460ddd733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.623609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f1b6683f-5250-4f92-8628-c8460ddd733d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.625188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f1b6683f-5250-4f92-8628-c8460ddd733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.635141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 778/1540] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.646355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ef40-bbf9-4b3f-a4c9-fa4b94eca938 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.647333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ef40-bbf9-4b3f-a4c9-fa4b94eca938 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.647964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ef40-bbf9-4b3f-a4c9-fa4b94eca938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.669056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-09d1ef40-bbf9-4b3f-a4c9-fa4b94eca938 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.670543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-09d1ef40-bbf9-4b3f-a4c9-fa4b94eca938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.677474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979481a-66f3-4df0-8b1b-17ad33a5e906 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.678006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979481a-66f3-4df0-8b1b-17ad33a5e906 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.678679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979481a-66f3-4df0-8b1b-17ad33a5e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.698684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 763/1541] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.700441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab3a7-84f3-4418-ba35-a1a42afc4288 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.700907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab3a7-84f3-4418-ba35-a1a42afc4288 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.702917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab3a7-84f3-4418-ba35-a1a42afc4288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.707745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a979481a-66f3-4df0-8b1b-17ad33a5e906 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.711967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a979481a-66f3-4df0-8b1b-17ad33a5e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.728143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ef4ab3a7-84f3-4418-ba35-a1a42afc4288 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.729547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ef4ab3a7-84f3-4418-ba35-a1a42afc4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.730381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 779/1542] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:16.731241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979481a-66f3-4df0-8b1b-17ad33a5e906 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:16.745784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979481a-66f3-4df0-8b1b-17ad33a5e906 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:16.746528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 764/1543] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.748039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c607e3e-8eb0-44d0-a375-83f45d1e9cb7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.748327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c607e3e-8eb0-44d0-a375-83f45d1e9cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.748607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c607e3e-8eb0-44d0-a375-83f45d1e9cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.752838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b1fa4-2c0d-43ef-b073-c92642438c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:16.753512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1fa4-2c0d-43ef-b073-c92642438c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.753794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1fa4-2c0d-43ef-b073-c92642438c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.754067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b1fa4-2c0d-43ef-b073-c92642438c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.755071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b1fa4-2c0d-43ef-b073-c92642438c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:16.755407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b1fa4-2c0d-43ef-b073-c92642438c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:16.762901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b1fa4-2c0d-43ef-b073-c92642438c78 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:16.776225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0c607e3e-8eb0-44d0-a375-83f45d1e9cb7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.777638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0c607e3e-8eb0-44d0-a375-83f45d1e9cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.785207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 780/1544] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:16.786695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515a8e-04b8-4ef5-80e2-68e7835323e3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.786983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515a8e-04b8-4ef5-80e2-68e7835323e3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.787258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515a8e-04b8-4ef5-80e2-68e7835323e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.788399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 765/1545] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.790142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe7621-a07e-45f0-812d-f03a30c34078 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.790732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe7621-a07e-45f0-812d-f03a30c34078 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.791402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe7621-a07e-45f0-812d-f03a30c34078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.808267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a515a8e-04b8-4ef5-80e2-68e7835323e3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.809517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a515a8e-04b8-4ef5-80e2-68e7835323e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.813708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-45fe7621-a07e-45f0-812d-f03a30c34078 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.814873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-45fe7621-a07e-45f0-812d-f03a30c34078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.817512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 781/1546] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.818831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e23-6256-439b-8036-e403eb0b9d5c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.819118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e23-6256-439b-8036-e403eb0b9d5c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.819385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74e23-6256-439b-8036-e403eb0b9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.822943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 766/1547] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.824042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3675f7e-fc14-47a1-bd5c-78356dafdca1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.824318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3675f7e-fc14-47a1-bd5c-78356dafdca1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.824592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3675f7e-fc14-47a1-bd5c-78356dafdca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.840873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dbd74e23-6256-439b-8036-e403eb0b9d5c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.842061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dbd74e23-6256-439b-8036-e403eb0b9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.842359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c3675f7e-fc14-47a1-bd5c-78356dafdca1 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.843510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c3675f7e-fc14-47a1-bd5c-78356dafdca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.849738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 782/1548] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.852858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099f89-76bd-4704-81f7-ca8e4a6632ac None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.852858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099f89-76bd-4704-81f7-ca8e4a6632ac None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.853105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 767/1549] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.853207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099f89-76bd-4704-81f7-ca8e4a6632ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.853306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3675f7e-fc14-47a1-bd5c-78356dafdca1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:16.865111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3675f7e-fc14-47a1-bd5c-78356dafdca1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:16.870246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df8835-ae05-4abd-a768-a3d03cc7f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:16.870904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df8835-ae05-4abd-a768-a3d03cc7f035 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.871349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df8835-ae05-4abd-a768-a3d03cc7f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.871631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df8835-ae05-4abd-a768-a3d03cc7f035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.872044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-93099f89-76bd-4704-81f7-ca8e4a6632ac None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.872317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df8835-ae05-4abd-a768-a3d03cc7f035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:16.873248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-93099f89-76bd-4704-81f7-ca8e4a6632ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.874234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df8835-ae05-4abd-a768-a3d03cc7f035 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:16.881878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 783/1550] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.883456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d7ba-6741-45bb-8a26-39305e3322fe None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.883738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d7ba-6741-45bb-8a26-39305e3322fe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.884010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d7ba-6741-45bb-8a26-39305e3322fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.901847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 768/1551] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:16.903151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e81b9-fd22-4092-b73f-7b364745abc6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.903438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e81b9-fd22-4092-b73f-7b364745abc6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.903652 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e81b9-fd22-4092-b73f-7b364745abc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.906379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2f88d7ba-6741-45bb-8a26-39305e3322fe None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.907764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f88d7ba-6741-45bb-8a26-39305e3322fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.921789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d99e81b9-fd22-4092-b73f-7b364745abc6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.922917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d99e81b9-fd22-4092-b73f-7b364745abc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.969161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 784/1552] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.970598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9560b-66f7-4033-ace5-88f52c7fbffc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.970947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9560b-66f7-4033-ace5-88f52c7fbffc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.971290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9560b-66f7-4033-ace5-88f52c7fbffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.980251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 769/1553] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.981360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e81b9-fd22-4092-b73f-7b364745abc6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:16.989852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-30c9560b-66f7-4033-ace5-88f52c7fbffc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:16.990443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e81b9-fd22-4092-b73f-7b364745abc6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:16.991167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30c9560b-66f7-4033-ace5-88f52c7fbffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:16.994931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:16.995591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:16.995869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:16.996143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:16.996916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:16.997223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:16.998268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:16.998268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: warnings.warn(msg) May 19 12:05:16.998268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: May 19 12:05:16.999072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 785/1554] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:16.999196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48fae7-c7f3-44c1-a0a5-60bf9b286ce3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:16.999837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9560b-66f7-4033-ace5-88f52c7fbffc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.009658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9560b-66f7-4033-ace5-88f52c7fbffc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.013268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 770/1555] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:17.014529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031c47-dca2-4c75-8538-1b9d82ec675e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.014813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031c47-dca2-4c75-8538-1b9d82ec675e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.015087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92031c47-dca2-4c75-8538-1b9d82ec675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.018259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ae83-f3d8-4864-8ffd-8d5f04ebbeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.019035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ae83-f3d8-4864-8ffd-8d5f04ebbeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.019316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ae83-f3d8-4864-8ffd-8d5f04ebbeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.019583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ae83-f3d8-4864-8ffd-8d5f04ebbeb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.020574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ae83-f3d8-4864-8ffd-8d5f04ebbeb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:17.020954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ae83-f3d8-4864-8ffd-8d5f04ebbeb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.022631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ae83-f3d8-4864-8ffd-8d5f04ebbeb0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.033082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-92031c47-dca2-4c75-8538-1b9d82ec675e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:17.034379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-92031c47-dca2-4c75-8538-1b9d82ec675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:17.040381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 786/1556] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:17.040381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b425-9572-4b17-9072-51c0c3cb4e9b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.040381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b425-9572-4b17-9072-51c0c3cb4e9b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.040381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b425-9572-4b17-9072-51c0c3cb4e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.051789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 771/1557] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:17.051789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92031c47-dca2-4c75-8538-1b9d82ec675e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.055563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c466b425-9572-4b17-9072-51c0c3cb4e9b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:17.056845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c466b425-9572-4b17-9072-51c0c3cb4e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:17.060078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92031c47-dca2-4c75-8538-1b9d82ec675e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.065635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574597e9-3d6e-4344-96b3-6ed1698c8d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.066740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574597e9-3d6e-4344-96b3-6ed1698c8d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.067061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574597e9-3d6e-4344-96b3-6ed1698c8d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.067587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574597e9-3d6e-4344-96b3-6ed1698c8d20 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.068772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574597e9-3d6e-4344-96b3-6ed1698c8d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.070093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-574597e9-3d6e-4344-96b3-6ed1698c8d20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:17.070093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: warnings.warn(msg) May 19 12:05:17.070093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: May 19 12:05:17.070381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 787/1558] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:17.070854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b425-9572-4b17-9072-51c0c3cb4e9b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.071570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574597e9-3d6e-4344-96b3-6ed1698c8d20 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.080416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b425-9572-4b17-9072-51c0c3cb4e9b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.085499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.086331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.086528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.086830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.087547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:17.087810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.089503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.094100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 772/1559] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.095226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1a775-4c03-4122-84d2-53f6d9d673e5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.095532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1a775-4c03-4122-84d2-53f6d9d673e5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.095803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1a775-4c03-4122-84d2-53f6d9d673e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.104774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 788/1560] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:17.105678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.115939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9ff1a775-4c03-4122-84d2-53f6d9d673e5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:17.116131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba2c55-76b9-4a13-8f48-bd7a7d64efab admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.117176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9ff1a775-4c03-4122-84d2-53f6d9d673e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:17.120429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.121101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.121373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.121638 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.122356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:17.122653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.124322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.125101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 773/1561] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:17.125837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1a775-4c03-4122-84d2-53f6d9d673e5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.135336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1a775-4c03-4122-84d2-53f6d9d673e5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.139842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.140474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.140619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 789/1562] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:17.148485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.148485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.148706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.148812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.148812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.155978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0a94b-a858-4b43-be88-f9309bc30fa8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.161050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.161960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.162289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.162627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.163398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.164524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:17.164524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 12:05:17.164524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 12:05:17.165946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.175223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 774/1563] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.175223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.196191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 790/1564] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.196191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.220390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:17.237532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:17.241383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad144249-c790-4efe-8305-7d6a0448f83c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.258543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c90999-82fb-455c-a2fb-f8298b90b3e7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.263238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.263967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.264187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.264457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.265234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:17.265537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.267549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.280981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 791/1565] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:17.281960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.291754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e5109-a3d7-4097-bfff-230a94be8a4d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.296312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.296990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.297263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.297559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.298417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.300010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.306649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.307322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.307608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.307884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.308615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:17.308953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.310600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.311059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 792/1566] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:17.311852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.321808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cedf2a-3b88-4efe-95da-1a1e12e137c8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.327073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 775/1567] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:17.327073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.331242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.331895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.332174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.332445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.333344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.335358 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.336532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14a3c-b308-457a-9589-7ae359ce26ae admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.340958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.341592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.341867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.342133 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.342837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:17.343138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.344724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.357027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 776/1568] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:17.357857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.367755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 793/1569] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.368613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.373323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679a7b0-c32c-4078-b9e6-588607c9c6f2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.430083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.430757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.431038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.431310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.431998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.432923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6852d8-691e-4249-b474-8cfdf9c647cd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.433980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.439437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.440099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.440375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.441001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.441688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.443625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.462337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 777/1570] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.465592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.469952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 794/1571] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.469952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.477773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc9c35-c56d-49e7-8896-473e182b50d2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.525290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:17.535776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6625c0-0ad5-45db-9ba7-5556d568f24c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.540163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.540936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.541141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.541275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.541476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.541809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.542091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.542186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.542364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.543056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.544203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.545076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.570489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 778/1572] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.570489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.574105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 795/1573] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.574105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.577972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054490fc-959a-4e6a-841d-c02ee42c6f66 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.590415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:17.632868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.633532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.633843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.634112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.634835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.634973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564264a1-ebc9-4ef6-a2e0-b8495d9b61be admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.636430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.639841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.640536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.640845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.641102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.642169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.644121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.646839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 779/1574] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:17.650585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.659620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ea481-3ca4-4d6f-b1d0-16d1dd2246a9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.664547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.665231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.665515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.665792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.666481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.668439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.672021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 796/1575] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.672898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.702037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 780/1576] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.702970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.738057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1a67-21f2-4d2c-be59-f54a308c56db admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.765815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a93fe-804a-4191-a466-f91f7f1731bb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.771402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.772079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.772361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.772633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.773798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.775816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.797118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.797796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.798073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.798342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.799040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.800382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 781/1577] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.801209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.803874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.810913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba110e-315c-4ec8-b861-99616dc654d4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.815694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.816353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.816760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.817155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.817753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.819420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.827514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 797/1578] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.830066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 782/1579] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:17.831375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.831543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.841888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251e87b-ed8b-48df-9e34-2532e8c91d05 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.842430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d006-3746-4b51-bb84-44676fa29767 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.846645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.847290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.847572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.847847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.847940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.848525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.848620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.848981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.849336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.850013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.850533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.851656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.862162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 798/1580] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:17.862951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.873045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821357d-ea83-4afe-bc2c-3ca154002f66 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.877388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 783/1581] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.877388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.878204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.879095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.879374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.879644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] PATH_INFO: `/v3/projects/0ce848ee51f841638902e08ea1c2af28/users/36415049be5d4238a0275db21a8f378a/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.884806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b7bd-4149-49ea-92cc-b9a7a1fec1da admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.889259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.889899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.890182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.890455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.891123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.893436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.895284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce848ee51f841638902e08ea1c2af28, user_id=36415049be5d4238a0275db21a8f378a, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.896331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:17.896331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 12:05:17.896331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 12:05:17.898360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.910004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:17.914186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 799/1582] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:17 2022] PUT /identity/v3/projects/0ce848ee51f841638902e08ea1c2af28/users/36415049be5d4238a0275db21a8f378a/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:17.915126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.919491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 784/1583] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:17.919491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:17.922673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:17.929301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bb12-fd30-4823-b2e8-f527977e45ef admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.983304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.983999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.984278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.984429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c88b6-9483-43fc-8d27-81768d5fe67d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:17.984579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.985340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.987011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.988990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:17.989712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:17.989991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:17.990297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:17.990977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:17.992910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:17.996919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 785/1584] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:17.997694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.007414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1743cd-fbfd-4929-8ea4-cab557af3225 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.012749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.013537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.013814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.014105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.014765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 800/1585] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:17 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:18.014907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.015591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.016405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.025927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b44fff-25b9-4c33-bab1-02621c3bcfa9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.030417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 786/1586] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.030417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.033507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.034152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.034429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.034745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.035464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.037200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.040007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcadb5-e2fe-425d-917a-c71ee634f32b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.044492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c0a2f-c489-4c11-85fb-dc8ae15a1cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.045158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c0a2f-c489-4c11-85fb-dc8ae15a1cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.045431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c0a2f-c489-4c11-85fb-dc8ae15a1cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.045698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c0a2f-c489-4c11-85fb-dc8ae15a1cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.046410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c0a2f-c489-4c11-85fb-dc8ae15a1cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.047283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 801/1587] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.047964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c0a2f-c489-4c11-85fb-dc8ae15a1cf5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.051351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.058627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 787/1588] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.059846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe4f3-7591-4a84-89c3-806e14be19e9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.060125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe4f3-7591-4a84-89c3-806e14be19e9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.060389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe4f3-7591-4a84-89c3-806e14be19e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.063101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49328c7e-0361-4f5a-a08e-f95e0ee07973 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.067721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.068353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.068628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.068929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.069645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.071268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.076678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-331fe4f3-7591-4a84-89c3-806e14be19e9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:18.077855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-331fe4f3-7591-4a84-89c3-806e14be19e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:18.081127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 802/1589] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.081899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.088229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 788/1590] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:18.091312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fe4f3-7591-4a84-89c3-806e14be19e9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.091444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb23196-a4b7-41c0-9ee0-ca6f31665d61 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.096629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.097407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.097750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.098179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.098333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fe4f3-7591-4a84-89c3-806e14be19e9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.099054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.100981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.103305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.103958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.104230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.104496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.105256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.106831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.112167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 803/1591] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.113077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.120161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 789/1592] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.120889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.122617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e186e-46ff-4006-89eb-e15f324aa93e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.127250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.127907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.128151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.128422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.129179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.130827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.130938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e010-4b9f-4684-839c-443eb044f8ab admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.135422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.136092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.136336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.136604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.137357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.138917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.141390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 804/1593] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.142508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.150391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 790/1594] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.150391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.153751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab98969-d4a3-4e04-b84a-c8f5f38e55b6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.158213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.159071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.159346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.159613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] PATH_INFO: `/v3/projects/c6a2e937cae64681a70b82928e4c6928/users/7d110533a750491f9ff4e4834b25563a/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.162557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad2707-d99d-48f0-b3d8-20a62ca8551c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.167074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.167946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.168226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.168495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] PATH_INFO: `/v3/projects/3e6beb370f74431a8183d43d445c57f1/users/da7138773f60452e9f89cfd83ec67fce/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.174193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a2e937cae64681a70b82928e4c6928, user_id=7d110533a750491f9ff4e4834b25563a, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.176872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.183383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6beb370f74431a8183d43d445c57f1, user_id=da7138773f60452e9f89cfd83ec67fce, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.186378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.191256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 805/1595] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:18 2022] PUT /identity/v3/projects/c6a2e937cae64681a70b82928e4c6928/users/7d110533a750491f9ff4e4834b25563a/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:18.192177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.201761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 791/1596] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:18 2022] PUT /identity/v3/projects/3e6beb370f74431a8183d43d445c57f1/users/da7138773f60452e9f89cfd83ec67fce/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:18.202966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.258272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec04c-14e2-4cb1-9762-ff69b8d821fc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.267591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9d43-0aa7-402d-86ba-13b30fd0b9d2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.271615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.272258 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.272571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.273107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.288283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:18.307795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:18.318141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.318874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.319151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.319421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.320155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.321835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.332048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 806/1597] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.332876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.338207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.339659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.342249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2015-abfb-4968-a0ea-1683cd9a3d0d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.346660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.347287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.347694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.347975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.348707 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.349271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 792/1598] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:18.350028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.350322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.358989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eeeb0-2e99-4a24-ae6d-8cc914e99348 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.364246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 807/1599] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.364246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.366426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e431585-c4f0-4c4a-9d6d-317dc4058395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.367394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e431585-c4f0-4c4a-9d6d-317dc4058395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.367731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e431585-c4f0-4c4a-9d6d-317dc4058395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.368065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e431585-c4f0-4c4a-9d6d-317dc4058395 admin admin] PATH_INFO: `/v3/projects/50ab5e13c7394e5e91323bc7ed76c5f8/users/b4113cb440764819996cfffec45e0b76/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.374284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a744b-deb2-4513-9211-f0fd9df6a2ee admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.380023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.380809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.381186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.381424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.382150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.383828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.385762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e431585-c4f0-4c4a-9d6d-317dc4058395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ab5e13c7394e5e91323bc7ed76c5f8, user_id=b4113cb440764819996cfffec45e0b76, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.388823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e431585-c4f0-4c4a-9d6d-317dc4058395 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.399409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 808/1600] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:18.399409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.409911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ab563-906b-4d8c-9125-97c897d103d1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.410330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 793/1601] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:18 2022] PUT /identity/v3/projects/50ab5e13c7394e5e91323bc7ed76c5f8/users/b4113cb440764819996cfffec45e0b76/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:18.411806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8c0a-768a-4ffd-a536-1c538bdda677 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.412054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8c0a-768a-4ffd-a536-1c538bdda677 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.412322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8c0a-768a-4ffd-a536-1c538bdda677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.443032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dd8b8c0a-768a-4ffd-a536-1c538bdda677 None None] MFA Rules not processed for user `7d110533a750491f9ff4e4834b25563a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:18.444257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dd8b8c0a-768a-4ffd-a536-1c538bdda677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:18.479648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648543-5584-4a30-86e5-b18434a71f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.480930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648543-5584-4a30-86e5-b18434a71f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.481134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648543-5584-4a30-86e5-b18434a71f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.481538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648543-5584-4a30-86e5-b18434a71f7b admin admin] PATH_INFO: `/v3/projects/d6d8b4eca18542058d724bee909633e4/users/3c9ed3856c634f089e293d55eaca0be0/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.497622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648543-5584-4a30-86e5-b18434a71f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d8b4eca18542058d724bee909633e4, user_id=3c9ed3856c634f089e293d55eaca0be0, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.500396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648543-5584-4a30-86e5-b18434a71f7b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.518793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 809/1602] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:18 2022] PUT /identity/v3/projects/d6d8b4eca18542058d724bee909633e4/users/3c9ed3856c634f089e293d55eaca0be0/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:18.520141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be17c8-ce42-4336-8c52-17e9994dc5ea None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.520503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be17c8-ce42-4336-8c52-17e9994dc5ea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.520920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be17c8-ce42-4336-8c52-17e9994dc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.533648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 794/1603] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:18.534549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8c0a-768a-4ffd-a536-1c538bdda677 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.545619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8c0a-768a-4ffd-a536-1c538bdda677 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.552705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c7be17c8-ce42-4336-8c52-17e9994dc5ea None None] MFA Rules not processed for user `da7138773f60452e9f89cfd83ec67fce`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:18.553947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7be17c8-ce42-4336-8c52-17e9994dc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:18.623652 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.624784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.625072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.625328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] PATH_INFO: `/v3/projects/bb8c6f8383ec43868ace8748bdd3946b/users/3fc0a97d39d04020b8f933dbd5a57933/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.637114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 810/1604] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:18.638110 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be17c8-ce42-4336-8c52-17e9994dc5ea None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.642974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8c6f8383ec43868ace8748bdd3946b, user_id=3fc0a97d39d04020b8f933dbd5a57933, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.645699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.653687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be17c8-ce42-4336-8c52-17e9994dc5ea None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.659075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883bbf9-8eb1-42a9-8d07-1333468ad990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.660591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bbf9-8eb1-42a9-8d07-1333468ad990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.661559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bbf9-8eb1-42a9-8d07-1333468ad990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.662076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bbf9-8eb1-42a9-8d07-1333468ad990 admin admin] PATH_INFO: `/v3/projects/c7917b551c3c4cc9be8a007b5cc987d3/users/eefde2311ec64430a6ed161238024df4/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.666755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 795/1605] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:18 2022] PUT /identity/v3/projects/bb8c6f8383ec43868ace8748bdd3946b/users/3fc0a97d39d04020b8f933dbd5a57933/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:18.667672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.681870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883bbf9-8eb1-42a9-8d07-1333468ad990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7917b551c3c4cc9be8a007b5cc987d3, user_id=eefde2311ec64430a6ed161238024df4, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.685459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883bbf9-8eb1-42a9-8d07-1333468ad990 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.688565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:18.696131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:18.711044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 811/1606] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:18 2022] PUT /identity/v3/projects/c7917b551c3c4cc9be8a007b5cc987d3/users/eefde2311ec64430a6ed161238024df4/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:18.713530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ae4c8-d67d-4e5a-8e83-6a783f45a9d0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.714362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ae4c8-d67d-4e5a-8e83-6a783f45a9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.714362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ae4c8-d67d-4e5a-8e83-6a783f45a9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.732404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c71ae4c8-d67d-4e5a-8e83-6a783f45a9d0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:18.733645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c71ae4c8-d67d-4e5a-8e83-6a783f45a9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:18.750160 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27d6e-d91b-43ed-a689-6456a0d621ee admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.818695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 812/1607] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:18.821045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34632f7-91d6-4111-968c-782a98994f95 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.821344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34632f7-91d6-4111-968c-782a98994f95 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.821613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34632f7-91d6-4111-968c-782a98994f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.830299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dae30-27ae-46b7-9b0b-c0b5dc300b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.831236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dae30-27ae-46b7-9b0b-c0b5dc300b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.831511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dae30-27ae-46b7-9b0b-c0b5dc300b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.831777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dae30-27ae-46b7-9b0b-c0b5dc300b77 admin admin] PATH_INFO: `/v3/projects/d63d812572414784b282b79693df4d95/users/8c8b609d4a1f43fcb51a69a0c96984f5/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.847732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dae30-27ae-46b7-9b0b-c0b5dc300b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63d812572414784b282b79693df4d95, user_id=8c8b609d4a1f43fcb51a69a0c96984f5, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.850453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dae30-27ae-46b7-9b0b-c0b5dc300b77 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.850567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d34632f7-91d6-4111-968c-782a98994f95 None None] MFA Rules not processed for user `3c9ed3856c634f089e293d55eaca0be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:18.851725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d34632f7-91d6-4111-968c-782a98994f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:18.866294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 796/1608] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:18 2022] PUT /identity/v3/projects/d63d812572414784b282b79693df4d95/users/8c8b609d4a1f43fcb51a69a0c96984f5/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:18.867948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940749e9-d8aa-436b-b7ac-5eefb49905e9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.868231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940749e9-d8aa-436b-b7ac-5eefb49905e9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.868500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940749e9-d8aa-436b-b7ac-5eefb49905e9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.870117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 797/1609] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 12:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:18.870629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940749e9-d8aa-436b-b7ac-5eefb49905e9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:18.931752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 813/1610] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:18.933119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460b0e8-1179-4221-9d80-6d7642535330 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.933397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460b0e8-1179-4221-9d80-6d7642535330 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.933667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460b0e8-1179-4221-9d80-6d7642535330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.950620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940749e9-d8aa-436b-b7ac-5eefb49905e9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:18.951425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4460b0e8-1179-4221-9d80-6d7642535330 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:18.952627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4460b0e8-1179-4221-9d80-6d7642535330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:18.957026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b041-91b0-4b56-9cd8-fe24b2323fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:18.957416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b041-91b0-4b56-9cd8-fe24b2323fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.957695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b041-91b0-4b56-9cd8-fe24b2323fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.957963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b041-91b0-4b56-9cd8-fe24b2323fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.958707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b041-91b0-4b56-9cd8-fe24b2323fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:18.960997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b041-91b0-4b56-9cd8-fe24b2323fe4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:18.964435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 814/1611] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:18.964435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0c605-3a39-4cfe-9004-b272df66e0d6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:18.964435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0c605-3a39-4cfe-9004-b272df66e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:18.964435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0c605-3a39-4cfe-9004-b272df66e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:18.988621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-47d0c605-3a39-4cfe-9004-b272df66e0d6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:18.989905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-47d0c605-3a39-4cfe-9004-b272df66e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:18.998870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 815/1612] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:18.999778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0c605-3a39-4cfe-9004-b272df66e0d6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.005974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 798/1613] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:18 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:19.006894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfffec1-0068-443e-a02e-987332c93617 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.007185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfffec1-0068-443e-a02e-987332c93617 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.007455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfffec1-0068-443e-a02e-987332c93617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.029819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ecfffec1-0068-443e-a02e-987332c93617 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:19.031407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ecfffec1-0068-443e-a02e-987332c93617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:19.075318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0c605-3a39-4cfe-9004-b272df66e0d6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.079694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:19.110695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:19.146007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 799/1614] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 12:05:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:19.147562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8688-47d8-4b19-8864-928cb8ec9e3f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.149667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8688-47d8-4b19-8864-928cb8ec9e3f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.149667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8688-47d8-4b19-8864-928cb8ec9e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.169066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.169831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.170115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.170396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.186011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-94dd8688-47d8-4b19-8864-928cb8ec9e3f None None] MFA Rules not processed for user `8c8b609d4a1f43fcb51a69a0c96984f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:19.187661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-94dd8688-47d8-4b19-8864-928cb8ec9e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:19.257744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.259822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.272742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 816/1615] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:19.274613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.285338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b496667-9971-4802-b175-7b77ad649363 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.290835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.291565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.291565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.291830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.293368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.295550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.317907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 800/1616] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:19.319160 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8688-47d8-4b19-8864-928cb8ec9e3f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.339752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 817/1617] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:19 2022] POST /identity/v3/projects => generated 405 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:19.340665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.344871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8688-47d8-4b19-8864-928cb8ec9e3f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.442949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.443622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.443904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.444179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.464666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4f026-9147-4ada-9185-c381f09fadc0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.478431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.479129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.479408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.479676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.480687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.482672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.526636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 818/1618] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:19 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:19.527836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.540946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d30d9-6fe3-42ea-8529-48aa969f87a7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.545549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.546002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.546286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.546665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.563085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.565832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.567492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.568905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.586471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 819/1619] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:19.589021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.592785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 801/1620] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:19.594708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.608740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa074-55bd-4441-a175-0181d406d3e3 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.616765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.617810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.618753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.619120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.620018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.623825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.628410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:19.655311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:19.666507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 802/1621] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:19 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:19.667668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.703947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e0e0a-d902-4352-90ed-2c6c337b4354 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.759272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d2f1-4a29-4c3b-b233-d1ca02f0a497 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.769810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.770802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.771285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.771702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.772607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.775995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.786806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.788265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.788673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.789061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.812234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 803/1622] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:19 2022] POST /identity/v3/users => generated 309 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:19.814219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.827637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7310d8-bd2b-4df8-956d-d0383f29e612 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.834680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.835945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.836426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.836909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.837793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.841989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.856477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 804/1623] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:19.857616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.860793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.862553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.872770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e5ef-b380-4e59-abbf-519d0e1df756 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.883770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 820/1624] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:19.886805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.891836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.894283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.894566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.894840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.897426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.904157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.910154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c4262-8893-4d64-95da-8d5eac68e4df service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.921097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.922039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.922384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.922788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.923616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:19.928029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:19.950464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 821/1625] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:19.955099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.970948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 805/1626] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:19 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:19.977192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:19.979785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff1c3-3ce5-44d0-91a2-1225f57582a1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.991089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac307-51f2-4e08-bf76-69782b3512ff admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:19.992756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.993908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:19.994255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:19.994675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] PATH_INFO: `/v3/projects/9da991db318641f5a37013395500309f/users/8bdb4b456a1e4a5ebb822e6164040434/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:19.998618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:19.999906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.000995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.001478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] PATH_INFO: `/v3/projects/33a93d33173a40a1b101a65446d3037e/users/c2023ba901e34965ad1fdcd33b0d8c9d/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.029341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da991db318641f5a37013395500309f, user_id=8bdb4b456a1e4a5ebb822e6164040434, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.032075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.045780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a93d33173a40a1b101a65446d3037e, user_id=c2023ba901e34965ad1fdcd33b0d8c9d, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.050935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.067381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 822/1627] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:19 2022] PUT /identity/v3/projects/9da991db318641f5a37013395500309f/users/8bdb4b456a1e4a5ebb822e6164040434/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:20.068702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.071720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 806/1628] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:19 2022] PUT /identity/v3/projects/33a93d33173a40a1b101a65446d3037e/users/c2023ba901e34965ad1fdcd33b0d8c9d/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:20.082734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.142268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:20.194836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1dc0a-71cc-47c8-b2f7-eb42d68d1de8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.203465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.204890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.204890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.205843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.206615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.208288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.214212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849051a-c298-4e2b-8ed9-d06ea6c1b864 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.227287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 807/1629] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:20.230797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.231510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.231794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.232183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.232974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.234701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.237585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.253779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 823/1630] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:20.253779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.257692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a966a-f53f-4395-b51d-23e0869bc47d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.262540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.263096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.263381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.263655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.264407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.266076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.280887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad825bfc-f216-46e6-b226-b474933ccc35 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.282644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 808/1631] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:20.283634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.291290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acdc9a-b4d3-4d81-beb4-86763f88f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.292478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acdc9a-b4d3-4d81-beb4-86763f88f876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.292782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acdc9a-b4d3-4d81-beb4-86763f88f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.293436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acdc9a-b4d3-4d81-beb4-86763f88f876 admin admin] PATH_INFO: `/v3/projects/9da991db318641f5a37013395500309f/users/8bdb4b456a1e4a5ebb822e6164040434/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.294842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa274318-6d4a-42ae-add8-08a5d7ae4fb9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.296381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acdc9a-b4d3-4d81-beb4-86763f88f876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da991db318641f5a37013395500309f, user_id=8bdb4b456a1e4a5ebb822e6164040434, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.300001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acdc9a-b4d3-4d81-beb4-86763f88f876 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.300163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4401e0-b918-4494-83ac-1aa818e2713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.301212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4401e0-b918-4494-83ac-1aa818e2713b admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.301568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4401e0-b918-4494-83ac-1aa818e2713b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.301885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4401e0-b918-4494-83ac-1aa818e2713b admin admin] PATH_INFO: `/v3/projects/2b43df34963d4059b69032577161bd08/users/5ff1747d7280487caa0497116664afbe/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.306554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:20.327819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 824/1632] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:20 2022] PUT /identity/v3/projects/9da991db318641f5a37013395500309f/users/8bdb4b456a1e4a5ebb822e6164040434/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:20.327819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20180a-52d3-421b-8461-9fac3917bfd4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.327819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20180a-52d3-421b-8461-9fac3917bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.327819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20180a-52d3-421b-8461-9fac3917bfd4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.327819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 825/1633] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 12:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:20.327819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20180a-52d3-421b-8461-9fac3917bfd4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.334665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4401e0-b918-4494-83ac-1aa818e2713b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b43df34963d4059b69032577161bd08, user_id=5ff1747d7280487caa0497116664afbe, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.342576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4401e0-b918-4494-83ac-1aa818e2713b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.399338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 809/1634] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:20 2022] PUT /identity/v3/projects/2b43df34963d4059b69032577161bd08/users/5ff1747d7280487caa0497116664afbe/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:20.405872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a8b7f-baa5-41de-abb7-8aa6a627c06c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.406156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a8b7f-baa5-41de-abb7-8aa6a627c06c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.406429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a8b7f-baa5-41de-abb7-8aa6a627c06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.465050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8d9a8b7f-baa5-41de-abb7-8aa6a627c06c None None] MFA Rules not processed for user `8bdb4b456a1e4a5ebb822e6164040434`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:20.466484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8d9a8b7f-baa5-41de-abb7-8aa6a627c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:20.505256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20180a-52d3-421b-8461-9fac3917bfd4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.591188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 810/1635] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:20.593466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219e1fa-febf-4521-a129-c65beedbbc49 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.594637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219e1fa-febf-4521-a129-c65beedbbc49 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.595369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219e1fa-febf-4521-a129-c65beedbbc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.606982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.608073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.608486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.608819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] PATH_INFO: `/v3/projects/33a93d33173a40a1b101a65446d3037e/users/c2023ba901e34965ad1fdcd33b0d8c9d/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.611180 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a93d33173a40a1b101a65446d3037e, user_id=c2023ba901e34965ad1fdcd33b0d8c9d, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.613775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.636528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 826/1636] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:20 2022] PUT /identity/v3/projects/33a93d33173a40a1b101a65446d3037e/users/c2023ba901e34965ad1fdcd33b0d8c9d/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:20.636528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.642688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7219e1fa-febf-4521-a129-c65beedbbc49 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:20.644360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7219e1fa-febf-4521-a129-c65beedbbc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:20.753526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:20.771119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a906-d60e-4e0d-851c-3eb98c537e16 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.778852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.779605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.779959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.780264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.781213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:20.783018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:20.810856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 827/1637] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:20.814956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:20.825995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 811/1638] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:05:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:20.829695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ce44-e182-4f10-a9af-860ff9f794cd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.830176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ce44-e182-4f10-a9af-860ff9f794cd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.830606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ce44-e182-4f10-a9af-860ff9f794cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:20.890717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc47162-5218-4b57-948f-4a44b57ca0ba admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:20.893138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-acc7ce44-e182-4f10-a9af-860ff9f794cd None None] MFA Rules not processed for user `c2023ba901e34965ad1fdcd33b0d8c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:20.893866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-acc7ce44-e182-4f10-a9af-860ff9f794cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:20.896217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:20.897188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:20.897694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:20.898042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:21.009298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:21.046032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:21.049933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:21.057227 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 812/1639] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:21.057227 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ce44-e182-4f10-a9af-860ff9f794cd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:21.069486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ce44-e182-4f10-a9af-860ff9f794cd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:21.076617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417e07d-e0b3-448e-b7cd-a154c1c70185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:21.078361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417e07d-e0b3-448e-b7cd-a154c1c70185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:21.078740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417e07d-e0b3-448e-b7cd-a154c1c70185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:21.079109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417e07d-e0b3-448e-b7cd-a154c1c70185 admin admin] PATH_INFO: `/v3/projects/2b43df34963d4059b69032577161bd08/users/5ff1747d7280487caa0497116664afbe/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:21.083285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417e07d-e0b3-448e-b7cd-a154c1c70185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b43df34963d4059b69032577161bd08, user_id=5ff1747d7280487caa0497116664afbe, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:21.085603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 828/1640] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:21.086319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417e07d-e0b3-448e-b7cd-a154c1c70185 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:21.087368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:21.099234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 813/1641] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:21 2022] PUT /identity/v3/projects/2b43df34963d4059b69032577161bd08/users/5ff1747d7280487caa0497116664afbe/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:21.111849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9615-5daa-445f-9310-44a9b839d5ab None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:21.112783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9615-5daa-445f-9310-44a9b839d5ab None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:21.113236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9615-5daa-445f-9310-44a9b839d5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:21.114648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06601c2-eb62-4ec5-bf7b-eccf21d1d634 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:21.154846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-da6a9615-5daa-445f-9310-44a9b839d5ab None None] MFA Rules not processed for user `5ff1747d7280487caa0497116664afbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:21.156232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-da6a9615-5daa-445f-9310-44a9b839d5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:21.208047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:21.209429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:21.210231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:21.210231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:21.316004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 814/1642] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:21.316004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9615-5daa-445f-9310-44a9b839d5ab None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:21.318046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:21.329605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9615-5daa-445f-9310-44a9b839d5ab None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:21.353330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:21.354661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:21.355111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:21.355840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:21.415795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:21.423161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:21.440428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 829/1643] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:21.517189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:21.518902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:21.531892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 815/1644] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:21 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:21.885596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:21.897219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717a38d-261f-42b6-8844-741ae0dff69c service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:21.906438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273c98d-b4a0-4263-9f2d-a9aec6e36ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:21.907500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c98d-b4a0-4263-9f2d-a9aec6e36ede service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:21.907990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c98d-b4a0-4263-9f2d-a9aec6e36ede service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:21.908461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c98d-b4a0-4263-9f2d-a9aec6e36ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:21.934232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273c98d-b4a0-4263-9f2d-a9aec6e36ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:21.938320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273c98d-b4a0-4263-9f2d-a9aec6e36ede service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:21.980936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 830/1645] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:22.077256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:22.089080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807981a-7fee-4fde-9f81-94c2c4628d58 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:22.102901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:22.103724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:22.104102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:22.104506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:22.249924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:22.271917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:22.275231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:22.302643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 816/1646] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:22.557847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf378d57-e5a8-431a-bf29-1c0b8c05dc46 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:22.558526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf378d57-e5a8-431a-bf29-1c0b8c05dc46 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:22.559036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf378d57-e5a8-431a-bf29-1c0b8c05dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:22.613279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bf378d57-e5a8-431a-bf29-1c0b8c05dc46 None None] MFA Rules not processed for user `3fc0a97d39d04020b8f933dbd5a57933`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:22.618977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bf378d57-e5a8-431a-bf29-1c0b8c05dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:22.709523 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:22.732466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87799ba-8ca7-4966-9d09-af969c955d78 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:22.745413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df94371-a839-4a8c-a257-c1f0dd23c4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:22.747293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df94371-a839-4a8c-a257-c1f0dd23c4bc service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:22.747592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df94371-a839-4a8c-a257-c1f0dd23c4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:22.747862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df94371-a839-4a8c-a257-c1f0dd23c4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:22.833956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 831/1647] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:22.834864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf378d57-e5a8-431a-bf29-1c0b8c05dc46 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:22.863053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df94371-a839-4a8c-a257-c1f0dd23c4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:22.865367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df94371-a839-4a8c-a257-c1f0dd23c4bc service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:22.878472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 817/1648] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:22.880196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81780c-ad9d-4484-b5aa-0d8c8b70de7c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:22.880729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81780c-ad9d-4484-b5aa-0d8c8b70de7c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:22.881818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81780c-ad9d-4484-b5aa-0d8c8b70de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:22.905682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2c81780c-ad9d-4484-b5aa-0d8c8b70de7c None None] MFA Rules not processed for user `3fc0a97d39d04020b8f933dbd5a57933`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:22.907176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2c81780c-ad9d-4484-b5aa-0d8c8b70de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:22.920567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 818/1649] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:22.932321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81780c-ad9d-4484-b5aa-0d8c8b70de7c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:22.964415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81780c-ad9d-4484-b5aa-0d8c8b70de7c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:22.982739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f848dc-cf5d-4383-b02b-3819c8f39450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:22.984002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f848dc-cf5d-4383-b02b-3819c8f39450 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:22.984383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f848dc-cf5d-4383-b02b-3819c8f39450 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:22.984776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f848dc-cf5d-4383-b02b-3819c8f39450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.014322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f848dc-cf5d-4383-b02b-3819c8f39450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:23.024118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f848dc-cf5d-4383-b02b-3819c8f39450 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:23.044204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf378d57-e5a8-431a-bf29-1c0b8c05dc46 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:23.059037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 819/1650] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:23.064909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:23.066311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.066311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.066519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] PATH_INFO: `/v3/users/3c9ed3856c634f089e293d55eaca0be0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.073381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9ed3856c634f089e293d55eaca0be0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:23.074978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:23.074978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: warnings.warn(msg) May 19 12:05:23.074978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: May 19 12:05:23.076066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:23.214999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9ed3856c634f089e293d55eaca0be0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:23.216109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9ed3856c634f089e293d55eaca0be0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:23.239274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9ed3856c634f089e293d55eaca0be0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:23.254009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:23.281129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9ed3856c634f089e293d55eaca0be0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:23.306073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2d35edb-7661-49b2-b3b9-0616e25630f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9ed3856c634f089e293d55eaca0be0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:23.347906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 832/1651] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:22 2022] DELETE /identity/v3/users/3c9ed3856c634f089e293d55eaca0be0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:23.353535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.355505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.356106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.398841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:23.407219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:23.463773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad6fc-a6dc-4f90-bf7d-42bfd6c7d812 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.464365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad6fc-a6dc-4f90-bf7d-42bfd6c7d812 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.465008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad6fc-a6dc-4f90-bf7d-42bfd6c7d812 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.467632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 833/1652] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 12:05:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:23.479095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89d0e-eb18-4619-b4a1-dad513de6986 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.480006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89d0e-eb18-4619-b4a1-dad513de6986 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.480752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89d0e-eb18-4619-b4a1-dad513de6986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.515974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9de89d0e-eb18-4619-b4a1-dad513de6986 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:23.519468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9de89d0e-eb18-4619-b4a1-dad513de6986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:23.551540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 820/1653] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:23.616356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:23.618466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:23.673224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 834/1654] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 12:05:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:23.679737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73b43c-b814-446a-b77f-f308c162ebdd None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.680042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73b43c-b814-446a-b77f-f308c162ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.680368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73b43c-b814-446a-b77f-f308c162ebdd None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.682265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 835/1655] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 12:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:23.689584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.689890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.690181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.730162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:23.731563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:23.756231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 836/1656] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:05:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:23.760823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ce8e3-17bd-4501-b4d1-e64eba948d2c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:23.765232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb50d8e-ba5f-486f-bfb2-f63f2e9a0b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:23.765903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50d8e-ba5f-486f-bfb2-f63f2e9a0b2f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.766178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50d8e-ba5f-486f-bfb2-f63f2e9a0b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.766879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50d8e-ba5f-486f-bfb2-f63f2e9a0b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.769559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:23.771175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:23.780905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb50d8e-ba5f-486f-bfb2-f63f2e9a0b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:23.785720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb50d8e-ba5f-486f-bfb2-f63f2e9a0b2f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:23.797816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 821/1657] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:23.849491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502bc41-90f6-44e0-8b13-558fb8f49ae7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:23.853857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69da51-4e29-47cd-857a-8265faed066d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:23.854637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69da51-4e29-47cd-857a-8265faed066d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:23.855041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69da51-4e29-47cd-857a-8265faed066d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:23.855462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69da51-4e29-47cd-857a-8265faed066d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:23.868309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69da51-4e29-47cd-857a-8265faed066d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:23.870129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69da51-4e29-47cd-857a-8265faed066d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:23.883617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 837/1658] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:05:24.261833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ef0d-abac-4b4f-a646-714b49b12d23 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:24.262125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ef0d-abac-4b4f-a646-714b49b12d23 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:24.298377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ef0d-abac-4b4f-a646-714b49b12d23 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:24.298377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 822/1659] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 12:05:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:24.298569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc3c5-4cf8-48fb-8107-fdcfc19f94ee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:24.298569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc3c5-4cf8-48fb-8107-fdcfc19f94ee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:24.298569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc3c5-4cf8-48fb-8107-fdcfc19f94ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:24.451209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-94fcc3c5-4cf8-48fb-8107-fdcfc19f94ee None None] MFA Rules not processed for user `9bb4c7ed74924ac4ad8f759437891569`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:24.456786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-94fcc3c5-4cf8-48fb-8107-fdcfc19f94ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:24.487588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 838/1660] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:05:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:24.534594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4ef0d-abac-4b4f-a646-714b49b12d23 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:24.562331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4ef0d-abac-4b4f-a646-714b49b12d23 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:24.574744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d2238-8f99-4115-b7ce-7e528d8a6a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:24.582281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d2238-8f99-4115-b7ce-7e528d8a6a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:24.584070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d2238-8f99-4115-b7ce-7e528d8a6a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:24.586098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d2238-8f99-4115-b7ce-7e528d8a6a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:24.625634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d2238-8f99-4115-b7ce-7e528d8a6a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:24.627524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d2238-8f99-4115-b7ce-7e528d8a6a94 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:24.638855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:24.658909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 823/1661] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:25.972884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3353-b611-44e9-aa31-ff474f3f2a4e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:25.973417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3353-b611-44e9-aa31-ff474f3f2a4e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:25.974573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3353-b611-44e9-aa31-ff474f3f2a4e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:25.976204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 839/1662] 10.222.0.35 () {54 vars in 960 bytes} [Thu May 19 12:05:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:25.982004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6ff7-0959-4d5f-8149-e3c1c2970516 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:25.982501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6ff7-0959-4d5f-8149-e3c1c2970516 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:25.982572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6ff7-0959-4d5f-8149-e3c1c2970516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:26.026082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-37de6ff7-0959-4d5f-8149-e3c1c2970516 None None] MFA Rules not processed for user `1f1c8f34e83d45c99e25f7fe3711e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:26.029310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-37de6ff7-0959-4d5f-8149-e3c1c2970516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:26.194788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd3353-b611-44e9-aa31-ff474f3f2a4e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:26.199915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d2fd3353-b611-44e9-aa31-ff474f3f2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:26.248080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd3353-b611-44e9-aa31-ff474f3f2a4e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:26.273040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:26.276184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:26.279086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:26.280460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] PATH_INFO: `/v3/projects/d6d8b4eca18542058d724bee909633e4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:26.282962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d8b4eca18542058d724bee909633e4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:26.290270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:26.336272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 824/1663] 10.222.0.35 () {58 vars in 1057 bytes} [Thu May 19 12:05:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:26.344797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de6ff7-0959-4d5f-8149-e3c1c2970516 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:26.371372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de6ff7-0959-4d5f-8149-e3c1c2970516 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:26.386751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:26.387606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:26.387945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:26.389342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:26.396695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:26.419653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:26.422289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:26.437699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:26.450556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 825/1664] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:05:26.453640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d8b4eca18542058d724bee909633e4', 'request_id': 'req-74d68403-3170-4506-8cd1-028e36fa8678'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:26.460412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d8b4eca18542058d724bee909633e4', 'request_id': 'req-74d68403-3170-4506-8cd1-028e36fa8678'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:26.472097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d8b4eca18542058d724bee909633e4', 'request_id': 'req-74d68403-3170-4506-8cd1-028e36fa8678'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:26.500124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] The token cache is being invalidate because project d6d8b4eca18542058d724bee909633e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:26.500406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:26.502353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:26.506297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 840/1665] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:26 2022] DELETE /identity/v3/projects/d6d8b4eca18542058d724bee909633e4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:26.510930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:26.569152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261a3d-d568-46d1-a16a-e786c2216cad service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:26.623185 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:26.624599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:26.811928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:26.812889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:26.813173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:26.816747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] PATH_INFO: `/v3/users/c2023ba901e34965ad1fdcd33b0d8c9d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:26.818572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2023ba901e34965ad1fdcd33b0d8c9d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:26.829935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:26.852916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d68403-3170-4506-8cd1-028e36fa8678 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:26.865852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:26.866826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:26.867108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:26.867376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] PATH_INFO: `/v3/users/7d110533a750491f9ff4e4834b25563a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:26.868722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d110533a750491f9ff4e4834b25563a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:26.870932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:26.989728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d110533a750491f9ff4e4834b25563a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:26.990549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d110533a750491f9ff4e4834b25563a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.011312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d110533a750491f9ff4e4834b25563a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.064610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2023ba901e34965ad1fdcd33b0d8c9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.065487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2023ba901e34965ad1fdcd33b0d8c9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.066112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2023ba901e34965ad1fdcd33b0d8c9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.077171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d110533a750491f9ff4e4834b25563a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.086311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2023ba901e34965ad1fdcd33b0d8c9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.094137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0bf1e84a-c46f-4cd8-aec6-02e2f289dea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d110533a750491f9ff4e4834b25563a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.110298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 841/1666] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:26 2022] DELETE /identity/v3/users/7d110533a750491f9ff4e4834b25563a => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:05:27.116222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2023ba901e34965ad1fdcd33b0d8c9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:27.117144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:27.117435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:27.120942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:27.129578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:27.149374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 826/1667] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:26 2022] DELETE /identity/v3/users/c2023ba901e34965ad1fdcd33b0d8c9d => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:27.188204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:27.189643 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:27.355155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:27.452562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 842/1668] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:27.469891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:27.472326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:27.636369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf72c73-48f3-4bbd-853b-8084cee9ca81 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:27.639668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e5bf3-6312-43ca-ad09-3ca92d398d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:27.640365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e5bf3-6312-43ca-ad09-3ca92d398d2f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:27.640629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e5bf3-6312-43ca-ad09-3ca92d398d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:27.640927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e5bf3-6312-43ca-ad09-3ca92d398d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:27.669340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e5bf3-6312-43ca-ad09-3ca92d398d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:27.670838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e5bf3-6312-43ca-ad09-3ca92d398d2f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:27.697900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 827/1669] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:05:27.956518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:27.958226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:27.984397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d77870-6327-4ecf-b7ce-b9d66a7cd0b4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:27.997395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:28.000628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:28.001688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:28.002119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] PATH_INFO: `/v3/projects/33a93d33173a40a1b101a65446d3037e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:28.006262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a93d33173a40a1b101a65446d3037e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:28.012220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:28.193925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a93d33173a40a1b101a65446d3037e', 'request_id': 'req-845e3b22-dcd9-4135-aaa5-aca7a2622820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.233492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a93d33173a40a1b101a65446d3037e', 'request_id': 'req-845e3b22-dcd9-4135-aaa5-aca7a2622820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.250356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a93d33173a40a1b101a65446d3037e', 'request_id': 'req-845e3b22-dcd9-4135-aaa5-aca7a2622820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.284427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] The token cache is being invalidate because project 33a93d33173a40a1b101a65446d3037e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:28.284975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.288600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.292464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 843/1670] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:27 2022] DELETE /identity/v3/projects/33a93d33173a40a1b101a65446d3037e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:28.300556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc1d73-cd40-4209-86eb-7bf2869d3897 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:28.301696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc1d73-cd40-4209-86eb-7bf2869d3897 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:28.302105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc1d73-cd40-4209-86eb-7bf2869d3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:28.330516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-89fc1d73-cd40-4209-86eb-7bf2869d3897 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:28.331963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-89fc1d73-cd40-4209-86eb-7bf2869d3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:28.342314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:28.344088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:28.447087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 828/1671] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:28.464890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64259497-8765-42ed-a058-3062ca31d2b7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:28.465140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64259497-8765-42ed-a058-3062ca31d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:28.465563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64259497-8765-42ed-a058-3062ca31d2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:28.465705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3b22-dcd9-4135-aaa5-aca7a2622820 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:28.488696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:28.490928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-64259497-8765-42ed-a058-3062ca31d2b7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:28.492476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-64259497-8765-42ed-a058-3062ca31d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:28.515662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:28.522888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:28.523770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] PATH_INFO: `/v3/projects/c6a2e937cae64681a70b82928e4c6928` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:28.526374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a2e937cae64681a70b82928e4c6928)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:28.530213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:28.535941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 829/1672] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:28.543112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64259497-8765-42ed-a058-3062ca31d2b7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:28.583178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64259497-8765-42ed-a058-3062ca31d2b7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:28.589600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:28.590644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:28.591869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:28.593581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:28.594745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:28.595199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:28.597720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:28.625888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 830/1673] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:28.628537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:28.642571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074316f-9d08-4b46-a2bd-21021ee9cbd4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:28.669655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a2e937cae64681a70b82928e4c6928', 'request_id': 'req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.690731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a2e937cae64681a70b82928e4c6928', 'request_id': 'req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.704939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a2e937cae64681a70b82928e4c6928', 'request_id': 'req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.784133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] The token cache is being invalidate because project c6a2e937cae64681a70b82928e4c6928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:28.784623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.786006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74498e6b-a7a2-4b6e-bb68-3fe8557dc8d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:28.794417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 844/1674] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:28 2022] DELETE /identity/v3/projects/c6a2e937cae64681a70b82928e4c6928 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:05:28.798166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5755-0ba3-4718-84c4-1f92b50c1c91 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:28.798977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5755-0ba3-4718-84c4-1f92b50c1c91 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:28.799114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5755-0ba3-4718-84c4-1f92b50c1c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:28.811117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:28.811951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:28.812355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:28.812758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:28.813574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:28.816273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:28.819507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:28.862662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 831/1675] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:28 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:28.868987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:28.878149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:28.879606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1bdf5755-0ba3-4718-84c4-1f92b50c1c91 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:28.889561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1bdf5755-0ba3-4718-84c4-1f92b50c1c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:28.901568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:28.995983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cfc39-8c50-445f-b2a6-de20e5d29835 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.005681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.006609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.006989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.007359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.010515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.010515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.058544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 832/1676] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:28 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:29.064401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.090715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393851b-3c25-4ee9-b7df-60ac2a39320f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.104080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 845/1677] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:29.107106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae2685-3f7e-4a5a-a784-4c2e49035c1f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.107595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae2685-3f7e-4a5a-a784-4c2e49035c1f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.108128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae2685-3f7e-4a5a-a784-4c2e49035c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.109906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.110897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.111278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.111683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.112520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.114645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.138925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 833/1678] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:29.144979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.156885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-71ae2685-3f7e-4a5a-a784-4c2e49035c1f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:29.159016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-71ae2685-3f7e-4a5a-a784-4c2e49035c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:29.159976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921297c9-c30a-4ad9-8a6a-c98ee552c5f6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.172487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 846/1679] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:29.177176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae2685-3f7e-4a5a-a784-4c2e49035c1f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.187358 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae2685-3f7e-4a5a-a784-4c2e49035c1f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.190508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.191211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.191482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.191750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.192561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.193753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd9e6-021c-4762-aee0-554c6570f071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.195586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.195694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd9e6-021c-4762-aee0-554c6570f071 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.196190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd9e6-021c-4762-aee0-554c6570f071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.196828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd9e6-021c-4762-aee0-554c6570f071 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.197810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd9e6-021c-4762-aee0-554c6570f071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:29.198316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd9e6-021c-4762-aee0-554c6570f071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.200163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd9e6-021c-4762-aee0-554c6570f071 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.210785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 834/1680] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:29.212000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.238160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 847/1681] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:29.240127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d246-763b-48f9-97ac-1d3ef1e05489 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.240127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d246-763b-48f9-97ac-1d3ef1e05489 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.240534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d246-763b-48f9-97ac-1d3ef1e05489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.270758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53b31d-d8cb-44fc-bf0f-0a66646f8ba3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.275683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4506d246-763b-48f9-97ac-1d3ef1e05489 None None] MFA Rules not processed for user `36415049be5d4238a0275db21a8f378a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:29.277162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4506d246-763b-48f9-97ac-1d3ef1e05489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:29.284128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273c2dd-0f18-4575-9b94-6caaaacf54f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.285078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273c2dd-0f18-4575-9b94-6caaaacf54f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.285357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273c2dd-0f18-4575-9b94-6caaaacf54f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.285629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273c2dd-0f18-4575-9b94-6caaaacf54f4 admin admin] PATH_INFO: `/v3/projects/8705c4df28b541a98a237bf6fd55c79e/users/839469d77fb24432825e34f614a75ae1/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.344364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273c2dd-0f18-4575-9b94-6caaaacf54f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8705c4df28b541a98a237bf6fd55c79e, user_id=839469d77fb24432825e34f614a75ae1, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.349167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273c2dd-0f18-4575-9b94-6caaaacf54f4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.360116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 848/1682] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:29.361243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d246-763b-48f9-97ac-1d3ef1e05489 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.388501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d246-763b-48f9-97ac-1d3ef1e05489 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.389588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 835/1683] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:29 2022] PUT /identity/v3/projects/8705c4df28b541a98a237bf6fd55c79e/users/839469d77fb24432825e34f614a75ae1/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:29.391391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651660-5c2b-4a30-9147-edb32bd2f31a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.391848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651660-5c2b-4a30-9147-edb32bd2f31a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.392905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75651660-5c2b-4a30-9147-edb32bd2f31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.422120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-75651660-5c2b-4a30-9147-edb32bd2f31a None None] MFA Rules not processed for user `36415049be5d4238a0275db21a8f378a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:29.423558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-75651660-5c2b-4a30-9147-edb32bd2f31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:29.514291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 836/1684] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:29.516777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6e079-ec24-45f3-bf6b-c63d8a51f09f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.517204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6e079-ec24-45f3-bf6b-c63d8a51f09f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.527836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6e079-ec24-45f3-bf6b-c63d8a51f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.528244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.529105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.529497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.529939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.531012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.534602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.600232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f6b6e079-ec24-45f3-bf6b-c63d8a51f09f None None] MFA Rules not processed for user `839469d77fb24432825e34f614a75ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:29.610073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f6b6e079-ec24-45f3-bf6b-c63d8a51f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:29.624443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:29.637062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 849/1685] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:29 2022] POST /identity/v3/projects => generated 403 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:29.637062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.640136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:29.711238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:29.761323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 837/1686] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:29.763755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6e079-ec24-45f3-bf6b-c63d8a51f09f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.781808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6e079-ec24-45f3-bf6b-c63d8a51f09f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.856694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfc8f-374e-4181-9853-f82068e704e4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.873363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.874741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.875404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.875981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.877061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.878233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.878931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.879214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.879484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.880427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.915944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 838/1687] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:29 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:29.917286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:29.931859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d02849-8671-4d8a-b54d-ceb86e1e5093 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:29.939816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:29.941085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:29.941633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:29.942174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:29.943352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:29.946608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:29.992285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 839/1688] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:29 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:29.993698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.001563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.009665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.079147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 850/1689] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:30.081776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.108611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a97e4a-2fc7-4662-840f-a9281f775261 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.140032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eead448-9c54-4f27-bf61-04466b21a3ee admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.149787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.150711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.151258 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.151772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.152757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.154514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.187276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 840/1690] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:30.191452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.217840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c771b6-d761-4ff7-a982-1c98a207dae4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.228219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.229122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.229511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.229893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.230822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.242259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.270146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 841/1691] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:30.274938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.299720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836c1ee-5533-4e89-be9d-73d281e30836 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.309786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.310933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.310933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.311188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.320551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982abd-8fbe-4445-a076-e306e44975fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.321790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982abd-8fbe-4445-a076-e306e44975fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.322193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982abd-8fbe-4445-a076-e306e44975fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.322580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982abd-8fbe-4445-a076-e306e44975fe admin admin] PATH_INFO: `/v3/projects/eb83fc328dde4a5f94c93f5e15e27795/users/6127b09a3e5a47dd81f8fe012b541ba0/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.322772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.327333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.373145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 851/1692] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:30 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:30.374549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.386269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982abd-8fbe-4445-a076-e306e44975fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb83fc328dde4a5f94c93f5e15e27795, user_id=6127b09a3e5a47dd81f8fe012b541ba0, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.395397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb232eb-71fb-4c9e-b949-509e30132807 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.406626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982abd-8fbe-4445-a076-e306e44975fe admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.411854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.412743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.413026 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.413299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.414052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.415709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.438361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 842/1693] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:30 2022] PUT /identity/v3/projects/eb83fc328dde4a5f94c93f5e15e27795/users/6127b09a3e5a47dd81f8fe012b541ba0/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:30.445336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.445918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.446466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.447886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 852/1694] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:30.452246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.486359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985334-2703-4c8d-a4be-7f9e91a3b385 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.489097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:30.493705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:30.516398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:30.520854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:30.635895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.637743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.638036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.638306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] PATH_INFO: `/v3/projects/b8be60f4a6f840f9bf70d89e7f8d84a9/users/c9a306ef9d594ab38a4a61a92873a969/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.646081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 843/1695] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:30.664012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8be60f4a6f840f9bf70d89e7f8d84a9, user_id=c9a306ef9d594ab38a4a61a92873a969, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.667907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.669773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.670761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:30.715986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 853/1696] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:30 2022] PUT /identity/v3/projects/b8be60f4a6f840f9bf70d89e7f8d84a9/users/c9a306ef9d594ab38a4a61a92873a969/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:30.717088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.839718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d1140-0ec9-4e06-939b-89cd74f52334 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.845476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.846402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.846790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.847184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.848041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.853547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.854948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce3d5f-aff7-408a-8b47-043ed240dca8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.875130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 854/1697] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:30.879105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:30.905077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c20943-5913-4bf7-914d-cbf3a0cbd3b2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:30.920798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c63969-8393-4732-bc42-f2950e61a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.921843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63969-8393-4732-bc42-f2950e61a841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.922246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63969-8393-4732-bc42-f2950e61a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.922631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63969-8393-4732-bc42-f2950e61a841 admin admin] PATH_INFO: `/v3/projects/b8be60f4a6f840f9bf70d89e7f8d84a9/users/c9a306ef9d594ab38a4a61a92873a969/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.930423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c63969-8393-4732-bc42-f2950e61a841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8be60f4a6f840f9bf70d89e7f8d84a9, user_id=c9a306ef9d594ab38a4a61a92873a969, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.933437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c63969-8393-4732-bc42-f2950e61a841 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:30.956859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 855/1698] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:30 2022] PUT /identity/v3/projects/b8be60f4a6f840f9bf70d89e7f8d84a9/users/c9a306ef9d594ab38a4a61a92873a969/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:30.971409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:30.972528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.972937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.973242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.973612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01aba-d721-4cc9-9738-85e788dd25c8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:30.974000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01aba-d721-4cc9-9738-85e788dd25c8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:30.974392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01aba-d721-4cc9-9738-85e788dd25c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:30.991245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:30.993465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:31.008747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 844/1699] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:05:31.043421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5af01aba-d721-4cc9-9738-85e788dd25c8 None None] MFA Rules not processed for user `c9a306ef9d594ab38a4a61a92873a969`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:31.044976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5af01aba-d721-4cc9-9738-85e788dd25c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:31.308069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:31.309908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:31.313644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 856/1700] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:31.426246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbd115-619d-4c89-be99-9c7d74b51ef9 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:31.500514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:31.541099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab0b0c-7375-493a-9a52-01fc4aa9733f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:31.541819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab0b0c-7375-493a-9a52-01fc4aa9733f service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:31.542089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab0b0c-7375-493a-9a52-01fc4aa9733f service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:31.542362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab0b0c-7375-493a-9a52-01fc4aa9733f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:31.557259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab0b0c-7375-493a-9a52-01fc4aa9733f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:31.558461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab0b0c-7375-493a-9a52-01fc4aa9733f service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:31.587691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 845/1701] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:31.910543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c1dd-fb8a-48bd-99b1-4000cd618757 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:31.910990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c1dd-fb8a-48bd-99b1-4000cd618757 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:31.911413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c1dd-fb8a-48bd-99b1-4000cd618757 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:31.921804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 857/1702] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 12:05:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:31.930264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4eb52-0583-413f-870b-f29168b47a81 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:31.930861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4eb52-0583-413f-870b-f29168b47a81 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:31.931283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4eb52-0583-413f-870b-f29168b47a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:31.961440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f5f4eb52-0583-413f-870b-f29168b47a81 None None] MFA Rules not processed for user `9bb4c7ed74924ac4ad8f759437891569`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:31.963011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f5f4eb52-0583-413f-870b-f29168b47a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:32.041232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 846/1703] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:05:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:32.076613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559c1dd-fb8a-48bd-99b1-4000cd618757 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:32.078582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f559c1dd-fb8a-48bd-99b1-4000cd618757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:32.108277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:32.127286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559c1dd-fb8a-48bd-99b1-4000cd618757 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:32.134137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97cf5c-52cd-4cf4-bdd2-efa729706a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:32.134811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97cf5c-52cd-4cf4-bdd2-efa729706a58 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:32.135199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97cf5c-52cd-4cf4-bdd2-efa729706a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:32.135495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97cf5c-52cd-4cf4-bdd2-efa729706a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:32.162335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97cf5c-52cd-4cf4-bdd2-efa729706a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:32.166693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97cf5c-52cd-4cf4-bdd2-efa729706a58 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:32.190978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 858/1704] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:32.435979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4eb52-0583-413f-870b-f29168b47a81 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:32.586049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4eb52-0583-413f-870b-f29168b47a81 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:32.602218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:32.604044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:32.605531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:32.606016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] PATH_INFO: `/v3/users/839469d77fb24432825e34f614a75ae1` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:32.609836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839469d77fb24432825e34f614a75ae1)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:32.613726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:32.724059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839469d77fb24432825e34f614a75ae1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:32.731375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839469d77fb24432825e34f614a75ae1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:32.732489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839469d77fb24432825e34f614a75ae1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:32.759964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839469d77fb24432825e34f614a75ae1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:32.813772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839469d77fb24432825e34f614a75ae1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:32.876150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 847/1705] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:32 2022] DELETE /identity/v3/users/839469d77fb24432825e34f614a75ae1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:32.882101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29758594-22f5-4858-9ae9-860521213043 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:32.882909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29758594-22f5-4858-9ae9-860521213043 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:32.883327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29758594-22f5-4858-9ae9-860521213043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:32.911301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-29758594-22f5-4858-9ae9-860521213043 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:32.913073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-29758594-22f5-4858-9ae9-860521213043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:33.029421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 859/1706] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:33.066388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:33.069806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:33.093293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:33.258213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec5c5-514e-42e5-9eac-33a5062595e2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:33.258511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec5c5-514e-42e5-9eac-33a5062595e2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:33.258827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec5c5-514e-42e5-9eac-33a5062595e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:33.271920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e34e5-9b91-43ff-8679-3ae20ca22c89 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:33.277378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:33.279019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:33.279478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:33.279916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:33.293451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:33.295195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:33.324456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f10ec5c5-514e-42e5-9eac-33a5062595e2 None None] MFA Rules not processed for user `eefde2311ec64430a6ed161238024df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:33.326033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f10ec5c5-514e-42e5-9eac-33a5062595e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:33.346768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 848/1707] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:33.589921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 860/1708] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:33.604356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:33.605836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:33.799277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d2c8-ce2e-4fde-8dbb-b555820fb4a1 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:33.807780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e546af8-2433-44d7-9099-439aa8c6430e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:33.808928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e546af8-2433-44d7-9099-439aa8c6430e service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:33.809457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e546af8-2433-44d7-9099-439aa8c6430e service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:33.809842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e546af8-2433-44d7-9099-439aa8c6430e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:33.828572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e546af8-2433-44d7-9099-439aa8c6430e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:33.831968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e546af8-2433-44d7-9099-439aa8c6430e service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:33.850293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 849/1709] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:34.064780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:34.065152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:34.067205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:34.107265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:34.123592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:34.280229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 861/1710] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:05:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:34.318129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:34.318715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:34.319047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:34.355496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] MFA Rules not processed for user `36415049be5d4238a0275db21a8f378a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:34.360281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:34.529357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 850/1711] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:34.628040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:34.630170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:34.763214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:34.907033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1bce7-295b-498a-89f3-504abacf8103 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:34.920885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6abc9-7cac-42e7-a528-e9fd20aaf548 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:34.923310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6abc9-7cac-42e7-a528-e9fd20aaf548 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:34.923873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6abc9-7cac-42e7-a528-e9fd20aaf548 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:34.924303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6abc9-7cac-42e7-a528-e9fd20aaf548 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:34.952960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6abc9-7cac-42e7-a528-e9fd20aaf548 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:34.959449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6abc9-7cac-42e7-a528-e9fd20aaf548 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:34.985695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 862/1712] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:05:35.156892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:35.159050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:35.185237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b07e5-5cc9-4202-a3ec-7b43a93eba03 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:35.199623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:35.200526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:35.200835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:35.201156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] PATH_INFO: `/v3/projects/8705c4df28b541a98a237bf6fd55c79e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:35.204214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8705c4df28b541a98a237bf6fd55c79e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:35.205298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:35.205298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: warnings.warn(msg) May 19 12:05:35.205298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: May 19 12:05:35.206549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:35.265461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:35.266211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:35.266355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:35.361951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] MFA Rules not processed for user `6127b09a3e5a47dd81f8fe012b541ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:35.363077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:35.365799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:35.503490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8705c4df28b541a98a237bf6fd55c79e', 'request_id': 'req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:35.540845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8705c4df28b541a98a237bf6fd55c79e', 'request_id': 'req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:35.609455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8705c4df28b541a98a237bf6fd55c79e', 'request_id': 'req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:35.672344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] The token cache is being invalidate because project 8705c4df28b541a98a237bf6fd55c79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:35.675350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:35.686914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:35.695810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 851/1713] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:35 2022] DELETE /identity/v3/projects/8705c4df28b541a98a237bf6fd55c79e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:35.711529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:35.732065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:35.735517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 863/1714] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:35.740318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:35.744128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:36.044199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a754f-f583-4176-b499-dee2b8839e23 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:36.061086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:36.061808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:36.062088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:36.062367 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:36.063066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:36.068665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:36.092587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b14c3-aa8c-4a88-ae0a-4d502cfc6891 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:36.126069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:36.127130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:36.127243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:36.127512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] PATH_INFO: `/v3/users/c9a306ef9d594ab38a4a61a92873a969` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:36.136328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a306ef9d594ab38a4a61a92873a969)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:36.145663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 864/1715] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:35 2022] POST /identity/v3/projects => generated 403 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:36.155173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:36.155349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:36.164234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:36.323460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:36.386429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a306ef9d594ab38a4a61a92873a969'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:36.387510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a306ef9d594ab38a4a61a92873a969'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:36.388448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a306ef9d594ab38a4a61a92873a969'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:36.410201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a306ef9d594ab38a4a61a92873a969'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:36.425184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb6473-01b9-4352-a6e4-2522b400e2be admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:36.438666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:36.439523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:36.440115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:36.442356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:36.444448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:36.449427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:36.461135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a306ef9d594ab38a4a61a92873a969'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:36.504512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 865/1716] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:36 2022] POST /identity/v3/users => generated 308 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:36.506887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:36.518109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:36.530801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 852/1717] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:35 2022] DELETE /identity/v3/users/c9a306ef9d594ab38a4a61a92873a969 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:36.532316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:36.541596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450a0d-517b-4950-a571-c25612c51989 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:36.546241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:36.683282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:36.762230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757fe51-f408-4f95-8477-4016476116bf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:36.768565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:36.769324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:36.769716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:36.769936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:36.770860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:36.772424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:36.795759 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 853/1718] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:36.797635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:36.799483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:36.804622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:36.806082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:36.808362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] PATH_INFO: `/v3/users/da7138773f60452e9f89cfd83ec67fce` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:36.814601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e302ab6-87ae-46d2-9860-f10081760a3c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:36.815799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7138773f60452e9f89cfd83ec67fce)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:36.821583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:36.823511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:36.823511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:36.823511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] PATH_INFO: `/v3/projects/88f28cd782524f19a6a07daf15270a75/users/f3025c53ec9441aab7767a5a6facac8f/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:36.834784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:36.944880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f28cd782524f19a6a07daf15270a75, user_id=f3025c53ec9441aab7767a5a6facac8f, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:36.974324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:37.045784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 854/1719] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:36 2022] PUT /identity/v3/projects/88f28cd782524f19a6a07daf15270a75/users/f3025c53ec9441aab7767a5a6facac8f/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:37.062783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:37.148615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7138773f60452e9f89cfd83ec67fce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:37.151195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7138773f60452e9f89cfd83ec67fce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:37.182976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7138773f60452e9f89cfd83ec67fce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:37.244028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7138773f60452e9f89cfd83ec67fce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:37.262037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-17e48be6-b8c8-4c3b-af97-5f679ed6267a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7138773f60452e9f89cfd83ec67fce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:37.284245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 866/1720] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:36 2022] DELETE /identity/v3/users/da7138773f60452e9f89cfd83ec67fce => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:37.289305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:37.289937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:37.291701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:37.366689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:37.368552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:37.387738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6116cf8-089e-4307-ab30-272fb1ba3e4f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:37.473507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:37.591318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 867/1721] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:37.653793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:37.656340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:37.904901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3e655-b843-4ecb-9563-bb4d065efca6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:37.922689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:37.927203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:37.927516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:37.927802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:38.025558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:38.031557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:38.081603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 868/1722] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:05:38.126423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429cb7-b755-4772-b157-237719a4e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:38.127126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429cb7-b755-4772-b157-237719a4e061 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:38.127406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429cb7-b755-4772-b157-237719a4e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:38.127674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429cb7-b755-4772-b157-237719a4e061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:38.128410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35429cb7-b755-4772-b157-237719a4e061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:38.131218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35429cb7-b755-4772-b157-237719a4e061 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:38.153234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 855/1723] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 1103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:38.157134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:38.159022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:38.184103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e33e65-9eed-4f0b-a306-91fca0d2b15f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:38.190494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:38.191822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:38.192558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:38.193133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] PATH_INFO: `/v3/projects/88f28cd782524f19a6a07daf15270a75/users/f3025c53ec9441aab7767a5a6facac8f/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:38.196988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f28cd782524f19a6a07daf15270a75, user_id=f3025c53ec9441aab7767a5a6facac8f, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:38.201798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:38.227959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 869/1724] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:38 2022] PUT /identity/v3/projects/88f28cd782524f19a6a07daf15270a75/users/f3025c53ec9441aab7767a5a6facac8f/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:38.406392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:38.407521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:38.408069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:38.448858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] MFA Rules not processed for user `9bb4c7ed74924ac4ad8f759437891569`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:38.453725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:38.586889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 856/1725] 10.222.0.86 () {58 vars in 1015 bytes} [Thu May 19 12:05:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:38.629878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:38.633254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:38.656781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2cbe2-29b3-4b7e-a89b-ebde680eca64 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:38.670045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba5f85-de3f-458a-94ca-c79371591b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:38.671120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5f85-de3f-458a-94ca-c79371591b2b service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:38.671667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5f85-de3f-458a-94ca-c79371591b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:38.672311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5f85-de3f-458a-94ca-c79371591b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:38.689967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:38.693388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:38.705710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:38.708498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5f85-de3f-458a-94ca-c79371591b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:38.714502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5f85-de3f-458a-94ca-c79371591b2b service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:38.760970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 870/1726] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:38.861314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798f85a-2422-4619-9847-a6efad986c5f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:38.876740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:38.877767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:38.878146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:38.878642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] PATH_INFO: `/v3/projects/b8be60f4a6f840f9bf70d89e7f8d84a9` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:38.882876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8be60f4a6f840f9bf70d89e7f8d84a9)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:38.887912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:39.027477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8be60f4a6f840f9bf70d89e7f8d84a9', 'request_id': 'req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:39.037539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8be60f4a6f840f9bf70d89e7f8d84a9', 'request_id': 'req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:39.052070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8be60f4a6f840f9bf70d89e7f8d84a9', 'request_id': 'req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:39.085584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] The token cache is being invalidate because project b8be60f4a6f840f9bf70d89e7f8d84a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:39.087191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:39.089512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b59d3d1-f60a-4bc2-85ce-83ea4f518473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:39.104125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 857/1727] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:38 2022] DELETE /identity/v3/projects/b8be60f4a6f840f9bf70d89e7f8d84a9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:39.106089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e767d-5bcc-433f-baa4-3351c68b3ead None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:39.106570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e767d-5bcc-433f-baa4-3351c68b3ead None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:39.106915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e767d-5bcc-433f-baa4-3351c68b3ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:39.149671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-209e767d-5bcc-433f-baa4-3351c68b3ead None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:39.151159 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-209e767d-5bcc-433f-baa4-3351c68b3ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:39.372104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 871/1728] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:39.379734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c515-625d-4095-92f2-92f85f27d49f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:39.380020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c515-625d-4095-92f2-92f85f27d49f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:39.380384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c515-625d-4095-92f2-92f85f27d49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:39.421084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cf47c515-625d-4095-92f2-92f85f27d49f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:39.423943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cf47c515-625d-4095-92f2-92f85f27d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:39.474162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e767d-5bcc-433f-baa4-3351c68b3ead None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:39.476933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 858/1729] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:39.528960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e767d-5bcc-433f-baa4-3351c68b3ead None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:39.574949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:39.581809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:39.582163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:39.582474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:39.587418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:39.590903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:39.609881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:39.653297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 872/1730] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:05:39.658572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c515-625d-4095-92f2-92f85f27d49f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:39.677554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c515-625d-4095-92f2-92f85f27d49f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:39.685671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:39.687216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:39.687892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:39.688416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:39.689852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:39.696183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:39.762215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 859/1731] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:39 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:39.764507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:39.799056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7939d-aae0-46aa-824d-653f6fca88d5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:39.940085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:39.985723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:39.986679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:39.986969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:39.987246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:39.988431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:40.002611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:40.077077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 873/1732] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:39 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:40.080704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:40.094726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59266a20-5fd6-4ce8-a654-bd8efbe4dd23 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:40.113264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:40.115277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:40.115596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:40.117162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:40.119624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:40.125910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:40.175146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:40.185081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 860/1733] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:40.194216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f398ce2-02bc-49a0-a708-22479cb0c958 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:40.210504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e05a0e-55a9-40bf-a2e6-5c6a42a531ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:40.212506 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05a0e-55a9-40bf-a2e6-5c6a42a531ff admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:40.212823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05a0e-55a9-40bf-a2e6-5c6a42a531ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:40.213106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05a0e-55a9-40bf-a2e6-5c6a42a531ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:40.214591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e05a0e-55a9-40bf-a2e6-5c6a42a531ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:40.231338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e05a0e-55a9-40bf-a2e6-5c6a42a531ff admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:40.262862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:40.277050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 874/1734] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:40.291271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667f30d-2f1e-45d4-871a-735e7fc078a5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:40.318294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:40.319249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:40.319489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:40.319762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] PATH_INFO: `/v3/projects/a759f9a9c6b740258e8dba7e866dbfa7/users/a3ab1274d94f4bc19ea3021f9ee16f7b/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:40.368710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a759f9a9c6b740258e8dba7e866dbfa7, user_id=a3ab1274d94f4bc19ea3021f9ee16f7b, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:40.371437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:40.418677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 861/1735] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:40 2022] PUT /identity/v3/projects/a759f9a9c6b740258e8dba7e866dbfa7/users/a3ab1274d94f4bc19ea3021f9ee16f7b/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:05:40.420320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c4383-9896-40f7-8ba2-1a39bf464f44 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:40.420620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c4383-9896-40f7-8ba2-1a39bf464f44 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:40.420953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c4383-9896-40f7-8ba2-1a39bf464f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:40.623865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a21c4383-9896-40f7-8ba2-1a39bf464f44 None None] MFA Rules not processed for user `a3ab1274d94f4bc19ea3021f9ee16f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:40.635932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a21c4383-9896-40f7-8ba2-1a39bf464f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:40.917169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 875/1736] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:40.921617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:41.082340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:41.206231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeaf22-da3f-4c0a-83da-bc14ffbd5d78 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:41.229882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:41.232050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:41.232367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:41.233805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:41.234767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:41.240782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:41.403659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c4383-9896-40f7-8ba2-1a39bf464f44 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:41.414242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 862/1737] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:40 2022] POST /identity/v3/projects => generated 379 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:41.430551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c4383-9896-40f7-8ba2-1a39bf464f44 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:41.628859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:41.629749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:41.630558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:41.630933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:41.631751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:41.633947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:41.693647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:41.694828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 876/1738] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:41 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:41.716904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a629f-a92b-4f2f-9b72-f09a640e989c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:41.749153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:41.750030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:41.752808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:41.753190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:41.754492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:41.771083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:41.853455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:41.853644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 863/1739] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:41.869257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9844c1-1b4a-400b-9ec3-78a0ccbdb36d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:41.891318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a411b-04e0-41b6-8cfe-0fc8753a5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:41.893813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a411b-04e0-41b6-8cfe-0fc8753a5c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:41.894097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a411b-04e0-41b6-8cfe-0fc8753a5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:41.894464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a411b-04e0-41b6-8cfe-0fc8753a5c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:41.895324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a411b-04e0-41b6-8cfe-0fc8753a5c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:41.905368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a411b-04e0-41b6-8cfe-0fc8753a5c12 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:41.945184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 877/1740] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:41.949190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:41.967901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892bfbf-fca3-462b-8754-88f93ae7e354 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:41.991869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:41.996902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:41.997198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:41.997466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] PATH_INFO: `/v3/projects/80dcfb9850b14d4ea88c4417f5a81fc8/users/ccc7f84b2c744b8f9f402998c51d6328/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:42.061615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80dcfb9850b14d4ea88c4417f5a81fc8, user_id=ccc7f84b2c744b8f9f402998c51d6328, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:42.065892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:42.100720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 864/1741] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:41 2022] PUT /identity/v3/projects/80dcfb9850b14d4ea88c4417f5a81fc8/users/ccc7f84b2c744b8f9f402998c51d6328/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:42.112704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5cb80-3436-4b11-ac93-fcc75ab2651d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:42.113021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5cb80-3436-4b11-ac93-fcc75ab2651d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:42.113324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5cb80-3436-4b11-ac93-fcc75ab2651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:42.227199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b8c5cb80-3436-4b11-ac93-fcc75ab2651d None None] MFA Rules not processed for user `ccc7f84b2c744b8f9f402998c51d6328`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:42.228474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b8c5cb80-3436-4b11-ac93-fcc75ab2651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:42.272963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:42.469747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 878/1742] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:42.472066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:42.660927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:42.662922 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:42.663605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:42.731090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65e315-5b2c-4beb-a73b-3136fdadef24 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:42.732954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] MFA Rules not processed for user `b4113cb440764819996cfffec45e0b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:42.735432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:42.747918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:42.748564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:42.748877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:42.750728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:42.751525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:42.756446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:42.847497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 865/1743] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:42 2022] POST /identity/v3/projects => generated 379 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:42.851841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:42.938641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 879/1744] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:42.958605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:42.960304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:43.176381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b4f39-2572-4742-b541-1dd02353ee59 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:43.203825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:43.207926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:43.208212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:43.208489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:43.213519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:43.219142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:43.245131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:43.247877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dce55-e044-4b0d-906d-7763d7add4f7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:43.301345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 866/1745] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:42 2022] POST /identity/v3/users => generated 296 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:43.302526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:43.342869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c2c5-100b-4b1c-ad7c-eaaa12eda309 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:43.366464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:43.367021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:43.367373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:43.368800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:43.371450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:43.372677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:43.395977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:43.412396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 867/1746] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:43.417113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:43.443518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830adb6-3e31-49ba-9d05-ac7cc320904b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:43.454965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:43.455896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:43.456360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:43.456947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] PATH_INFO: `/v3/projects/0a4372f1f847476f8ddac467c2387606/users/a5e64417b85040fc9627fe481b49d2f1/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:43.486126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:43.487735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:43.488108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:43.488577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:43.512380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4372f1f847476f8ddac467c2387606, user_id=a5e64417b85040fc9627fe481b49d2f1, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:43.515146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:43.570037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 868/1747] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:43 2022] PUT /identity/v3/projects/0a4372f1f847476f8ddac467c2387606/users/a5e64417b85040fc9627fe481b49d2f1/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:43.597260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:43.656088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:43.658344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:43.683187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 880/1748] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:43.840092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643fae-93fc-43f0-8de9-7bf3c3a5ad14 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:43.847027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:43.852179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:43.852826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:43.853890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:43.854851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:43.858375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:43.895448 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 869/1749] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:43.900806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:43.921923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e67f4-6a1b-458e-b27d-d10caafa493e service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:43.945979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eba258-da2e-4fd3-9e0b-61abb84ca890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:43.952771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba258-da2e-4fd3-9e0b-61abb84ca890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:43.953304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba258-da2e-4fd3-9e0b-61abb84ca890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:43.953683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba258-da2e-4fd3-9e0b-61abb84ca890 admin admin] PATH_INFO: `/v3/projects/0a4372f1f847476f8ddac467c2387606/users/a5e64417b85040fc9627fe481b49d2f1/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:43.959468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eba258-da2e-4fd3-9e0b-61abb84ca890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4372f1f847476f8ddac467c2387606, user_id=a5e64417b85040fc9627fe481b49d2f1, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:43.969619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eba258-da2e-4fd3-9e0b-61abb84ca890 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:43.980121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:43.982302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:44.004921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fe0bd-5251-4e22-9466-c30ce82b306e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:44.009799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 881/1750] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:43 2022] PUT /identity/v3/projects/0a4372f1f847476f8ddac467c2387606/users/a5e64417b85040fc9627fe481b49d2f1/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:44.020339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:44.021021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:44.021528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:44.107009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] MFA Rules not processed for user `a5e64417b85040fc9627fe481b49d2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:44.109017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:44.258286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:44.260377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:44.264587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:44.264863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] PATH_INFO: `/v3/projects/3e6beb370f74431a8183d43d445c57f1` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:44.277124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6beb370f74431a8183d43d445c57f1)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:44.279334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:44.442234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 882/1751] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:44.451561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:44.453316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:44.601794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6beb370f74431a8183d43d445c57f1', 'request_id': 'req-e9be4f9b-0003-49d0-9832-ccf91698f1d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:44.625699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:44.635129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6beb370f74431a8183d43d445c57f1', 'request_id': 'req-e9be4f9b-0003-49d0-9832-ccf91698f1d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:44.668042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6beb370f74431a8183d43d445c57f1', 'request_id': 'req-e9be4f9b-0003-49d0-9832-ccf91698f1d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:44.707341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f5a81-0097-4c89-b5c9-422ef61a9dc0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:44.717082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] The token cache is being invalidate because project 3e6beb370f74431a8183d43d445c57f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:44.717694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:44.718520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:44.724176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 870/1752] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:43 2022] DELETE /identity/v3/projects/3e6beb370f74431a8183d43d445c57f1 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:44.725524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:44.727675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:44.749525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:44.927985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:44.929681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:44.932327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:44.933378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:44.939271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:44.940236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be4f9b-0003-49d0-9832-ccf91698f1d4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:44.953530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:44.954071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:44.954453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:44.954968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] PATH_INFO: `/v3/users/8bdb4b456a1e4a5ebb822e6164040434` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:44.959914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdb4b456a1e4a5ebb822e6164040434)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:44.962209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:45.118155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdb4b456a1e4a5ebb822e6164040434'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:45.119273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdb4b456a1e4a5ebb822e6164040434'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:45.120016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdb4b456a1e4a5ebb822e6164040434'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:45.145532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdb4b456a1e4a5ebb822e6164040434'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:45.165442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:45.169100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:45.188134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-45027d93-d796-44d2-82cd-7f869a4363b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdb4b456a1e4a5ebb822e6164040434'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:45.200272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 883/1753] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:45.227880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 871/1754] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:44 2022] DELETE /identity/v3/users/8bdb4b456a1e4a5ebb822e6164040434 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:45.266257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:45.268006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:45.291905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ef06-b5d7-448a-973b-c46805171938 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:45.421736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab622b7-f06e-4fe3-98bb-0050b4dcbf55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:45.422550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab622b7-f06e-4fe3-98bb-0050b4dcbf55 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:45.422883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab622b7-f06e-4fe3-98bb-0050b4dcbf55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:45.423399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab622b7-f06e-4fe3-98bb-0050b4dcbf55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:45.427645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8ab622b7-f06e-4fe3-98bb-0050b4dcbf55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:45.582621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab622b7-f06e-4fe3-98bb-0050b4dcbf55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:45.585804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab622b7-f06e-4fe3-98bb-0050b4dcbf55 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:45.609645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 884/1755] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:45.640035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd14b9-fe61-42e1-b58f-c4a2000aaa0c None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:45.641478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd14b9-fe61-42e1-b58f-c4a2000aaa0c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:45.641925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd14b9-fe61-42e1-b58f-c4a2000aaa0c None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:45.648185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 872/1756] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 12:05:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:45.762737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:45.762737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:45.762737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:45.839209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:45.846801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:45.919722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:46.139962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a309-c0a0-49ea-beff-9164c03c3f74 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:46.140596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a309-c0a0-49ea-beff-9164c03c3f74 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:46.140914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a309-c0a0-49ea-beff-9164c03c3f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:46.212589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 885/1757] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 12:05:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:46.268933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4340a309-c0a0-49ea-beff-9164c03c3f74 None None] MFA Rules not processed for user `f3025c53ec9441aab7767a5a6facac8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:46.271657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4340a309-c0a0-49ea-beff-9164c03c3f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:46.297313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:46.301258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:46.392111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffae065-159c-4577-9414-1ea6ca908ab3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:46.425787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:46.464097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee050a4-aed9-4f1e-9ebb-c4372417e497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:46.469338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee050a4-aed9-4f1e-9ebb-c4372417e497 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:46.469623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee050a4-aed9-4f1e-9ebb-c4372417e497 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:46.469904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee050a4-aed9-4f1e-9ebb-c4372417e497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:46.498550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee050a4-aed9-4f1e-9ebb-c4372417e497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:46.500411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee050a4-aed9-4f1e-9ebb-c4372417e497 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:46.510382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 873/1758] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:46.527792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 886/1759] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:46.893109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4fede-63e9-4870-9b7f-396df4e833ab None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:46.893109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4fede-63e9-4870-9b7f-396df4e833ab None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:46.893647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4fede-63e9-4870-9b7f-396df4e833ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:46.958685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-14a4fede-63e9-4870-9b7f-396df4e833ab None None] MFA Rules not processed for user `eefde2311ec64430a6ed161238024df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:46.969132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-14a4fede-63e9-4870-9b7f-396df4e833ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:47.117806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 874/1760] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:48.086141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312540f-2ffa-4a0e-8e24-8b5d85caaa87 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:48.086716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312540f-2ffa-4a0e-8e24-8b5d85caaa87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:48.086716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312540f-2ffa-4a0e-8e24-8b5d85caaa87 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:48.088253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 887/1761] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 12:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:48.230825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec14fe2-3357-45ed-8b4b-b48199b47b29 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:48.231384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec14fe2-3357-45ed-8b4b-b48199b47b29 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:48.231384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec14fe2-3357-45ed-8b4b-b48199b47b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:48.288252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7ec14fe2-3357-45ed-8b4b-b48199b47b29 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:48.289557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7ec14fe2-3357-45ed-8b4b-b48199b47b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:48.343265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 875/1762] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 12:05:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:49.456887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312540f-2ffa-4a0e-8e24-8b5d85caaa87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:49.458995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8312540f-2ffa-4a0e-8e24-8b5d85caaa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:49.639227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312540f-2ffa-4a0e-8e24-8b5d85caaa87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:49.646662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:49.647927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:49.648409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:49.648895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] PATH_INFO: `/v3/projects/9da991db318641f5a37013395500309f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:49.652031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da991db318641f5a37013395500309f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:49.656902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:49.830211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da991db318641f5a37013395500309f', 'request_id': 'req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:49.853039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da991db318641f5a37013395500309f', 'request_id': 'req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:49.861928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da991db318641f5a37013395500309f', 'request_id': 'req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:49.881956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] The token cache is being invalidate because project 9da991db318641f5a37013395500309f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:49.882441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:49.883104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:49.886006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 888/1763] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:49 2022] DELETE /identity/v3/projects/9da991db318641f5a37013395500309f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:49.892529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9c89-1660-4f37-bb52-bb777d4754c0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:49.893709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9c89-1660-4f37-bb52-bb777d4754c0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:49.894260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9c89-1660-4f37-bb52-bb777d4754c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:49.954580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c41f9c89-1660-4f37-bb52-bb777d4754c0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:49.961513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c41f9c89-1660-4f37-bb52-bb777d4754c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:50.154412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 876/1764] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:50.162291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.164253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38591-4815-4988-9a9f-ff3a34b85099 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.164519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38591-4815-4988-9a9f-ff3a34b85099 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.164814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38591-4815-4988-9a9f-ff3a34b85099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.167570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:50.210498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f621c1d-2cc7-4984-ac5d-cb5b0ea4b11c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:50.217680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dff38591-4815-4988-9a9f-ff3a34b85099 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:50.218894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dff38591-4815-4988-9a9f-ff3a34b85099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:50.220445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:50.221394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.221680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.221954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] PATH_INFO: `/v3/users/a3ab1274d94f4bc19ea3021f9ee16f7b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.225762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ab1274d94f4bc19ea3021f9ee16f7b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:50.237955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:50.243263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 877/1765] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:50.244773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38591-4815-4988-9a9f-ff3a34b85099 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.264075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38591-4815-4988-9a9f-ff3a34b85099 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:50.272076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:50.272799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.273081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.273350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.274083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:50.274395 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:50.275999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:50.284261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:50.337416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 878/1766] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:50.339856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.353321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ab1274d94f4bc19ea3021f9ee16f7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:50.354592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ab1274d94f4bc19ea3021f9ee16f7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:50.367107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ab1274d94f4bc19ea3021f9ee16f7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:50.381686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2647242-5cdb-4eef-a1b2-2f4609b1314a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:50.388225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ab1274d94f4bc19ea3021f9ee16f7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:50.398653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e3f5fe6-2585-495b-a031-01b81250bb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ab1274d94f4bc19ea3021f9ee16f7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:50.400384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:50.401966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.403757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.404913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.406557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:50.408731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 889/1767] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:50 2022] DELETE /identity/v3/users/a3ab1274d94f4bc19ea3021f9ee16f7b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:50.412900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:50.413905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdc2ca-1fed-4c15-867e-b7635792305a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.414353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdc2ca-1fed-4c15-867e-b7635792305a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.415202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdc2ca-1fed-4c15-867e-b7635792305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.469057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 879/1768] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:50 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:50.475027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.478860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:50.486895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e1fdc2ca-1fed-4c15-867e-b7635792305a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:50.490512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e1fdc2ca-1fed-4c15-867e-b7635792305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:50.617785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:50.670186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4e3e-9e5d-4982-a207-1feb4e1421f5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:50.693826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 890/1769] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:50.694895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:50.694895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.694895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.694895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.695232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:50.696026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:50.762401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 880/1770] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:50 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:50.766570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdc2ca-1fed-4c15-867e-b7635792305a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.781549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdc2ca-1fed-4c15-867e-b7635792305a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:50.789036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:50.789909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.790481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.790852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.791751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:50.805107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:50.827246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.829054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:50.839964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 891/1771] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:50.843989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.861995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef60786-d255-4cd8-b064-6aa5c25c3bea admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:50.869028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:50.870031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.870406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.870773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.872477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:50.874417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:50.889748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 892/1772] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:50.894131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:50.909443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d8ea3-86f0-42c5-aa52-5f47fdd307a3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:50.927213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:50.928496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:50.928893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:50.929251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] PATH_INFO: `/v3/projects/f58cdb4208064cc49a0dfa94cf8e0778/users/3f1f93f7aadb4eff9416a339b63d7793/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:50.973260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58cdb4208064cc49a0dfa94cf8e0778, user_id=3f1f93f7aadb4eff9416a339b63d7793, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:50.981122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.001309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de4ac9-5cb8-4392-9bc1-d748b9ecb3b5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.013862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 893/1773] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:50 2022] PUT /identity/v3/projects/f58cdb4208064cc49a0dfa94cf8e0778/users/3f1f93f7aadb4eff9416a339b63d7793/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:51.023551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:51.024355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfcbda-b9f5-4224-bc9f-fefaa0a8a5c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.024355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfcbda-b9f5-4224-bc9f-fefaa0a8a5c3 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.024355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfcbda-b9f5-4224-bc9f-fefaa0a8a5c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.024355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfcbda-b9f5-4224-bc9f-fefaa0a8a5c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.024760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:51.025255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-25cfcbda-b9f5-4224-bc9f-fefaa0a8a5c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:51.055843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfcbda-b9f5-4224-bc9f-fefaa0a8a5c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.057543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfcbda-b9f5-4224-bc9f-fefaa0a8a5c3 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.097771 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 881/1774] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:51.108694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a7a4-074b-428e-910f-e49f12429b02 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.112067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a7a4-074b-428e-910f-e49f12429b02 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.112440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a7a4-074b-428e-910f-e49f12429b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.139285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df0e0f-38b9-4d74-a9e2-67996ac16e34 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.144000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.144789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.145077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.145347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.153800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:51.210635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7f67a7a4-074b-428e-910f-e49f12429b02 None None] MFA Rules not processed for user `3f1f93f7aadb4eff9416a339b63d7793`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:51.217788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7f67a7a4-074b-428e-910f-e49f12429b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:51.261588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.263475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.287362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 894/1775] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:51.416159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 882/1776] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:51.421198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:51.435951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8aca3b-72af-4de2-990e-6108a196b3b3 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.453801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.454344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.454624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.454892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.455921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.458035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.522771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 895/1777] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:51 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:51.527013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a7a4-074b-428e-910f-e49f12429b02 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:51.559346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a7a4-074b-428e-910f-e49f12429b02 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.638394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:51.669050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.670446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.671740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.672108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.673015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.675193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.706124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 883/1778] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:51 2022] POST /identity/v3/users => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:51.711011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:51.731852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea99e-7962-40b2-b22a-592506c6899e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.741665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.742568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.742856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.743168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.744282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.746310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.762650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 896/1779] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:51.764156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:51.776045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14e7cb-c769-480f-aecd-3223b99b9ecf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.782227 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.783166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.784780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.786047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] PATH_INFO: `/v3/projects/84c3c11173524d66aff911168774c5c6/users/af0547d8f74f4470b0bb84d5b7bf4699/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.811165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c3c11173524d66aff911168774c5c6, user_id=af0547d8f74f4470b0bb84d5b7bf4699, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.814076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.845738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 884/1780] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:51 2022] PUT /identity/v3/projects/84c3c11173524d66aff911168774c5c6/users/af0547d8f74f4470b0bb84d5b7bf4699/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:51.850081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:51.862360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5b998-da2d-46d5-a133-4a344f3fff8f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.941489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9396-a73d-4caf-9758-b7172398e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.942634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9396-a73d-4caf-9758-b7172398e5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.942634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9396-a73d-4caf-9758-b7172398e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.942994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9396-a73d-4caf-9758-b7172398e5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.943834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9396-a73d-4caf-9758-b7172398e5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.945960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9396-a73d-4caf-9758-b7172398e5c7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:51.960000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 897/1781] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:51.963945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:51.975023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cad42-1fc7-4858-b5d3-31ac2971d972 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:51.981258 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:51.983060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:51.983244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:51.983520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] PATH_INFO: `/v3/projects/84c3c11173524d66aff911168774c5c6/users/af0547d8f74f4470b0bb84d5b7bf4699/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:51.987372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c3c11173524d66aff911168774c5c6, user_id=af0547d8f74f4470b0bb84d5b7bf4699, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:51.990982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:52.003796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 885/1782] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:51 2022] PUT /identity/v3/projects/84c3c11173524d66aff911168774c5c6/users/af0547d8f74f4470b0bb84d5b7bf4699/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:52.015838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:52.016142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:52.016407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:52.049225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] MFA Rules not processed for user `af0547d8f74f4470b0bb84d5b7bf4699`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:52.050945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:52.142099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:52.180969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 898/1783] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:52.190886 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:52.193233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:52.308478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d26735-ca2e-4270-be98-5f1628b5e148 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:52.313035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:52.313688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:52.313997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:52.314265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:52.327550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:52.329044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:52.345648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 886/1784] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:52.406017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:52.406517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:52.418880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a51dd-b37a-4bca-b677-7956980abf04 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:52.422555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:52.423286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:52.423624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:52.423964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:52.512080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:52.520714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:52.541068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 899/1785] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:52.594679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:52.596596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:52.704419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a940569-e82c-476c-80c4-f4e8524d7bfd service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:52.709773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:52.710475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:52.710832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:52.711150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] PATH_INFO: `/v3/projects/a759f9a9c6b740258e8dba7e866dbfa7` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:52.712427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a759f9a9c6b740258e8dba7e866dbfa7)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:52.714676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:52.767777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:52.770209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a759f9a9c6b740258e8dba7e866dbfa7', 'request_id': 'req-a58f3f67-6849-4cc6-81ef-60d4da8517ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:52.780064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a759f9a9c6b740258e8dba7e866dbfa7', 'request_id': 'req-a58f3f67-6849-4cc6-81ef-60d4da8517ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:52.790174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a759f9a9c6b740258e8dba7e866dbfa7', 'request_id': 'req-a58f3f67-6849-4cc6-81ef-60d4da8517ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:52.805794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] The token cache is being invalidate because project a759f9a9c6b740258e8dba7e866dbfa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:52.806383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:52.807381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a58f3f67-6849-4cc6-81ef-60d4da8517ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:52.809313 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 887/1786] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:52 2022] DELETE /identity/v3/projects/a759f9a9c6b740258e8dba7e866dbfa7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:52.813130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:52.825323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98211049-7881-4cc3-b6e1-2bade2c45aa1 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:52.837438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:52.838157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:52.840768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:52.871120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] MFA Rules not processed for user `b4113cb440764819996cfffec45e0b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:52.872588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:52.926842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:52.928019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:52.928417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:52.928804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] PATH_INFO: `/v3/users/ccc7f84b2c744b8f9f402998c51d6328` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:52.930318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc7f84b2c744b8f9f402998c51d6328)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:52.933426 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:52.950809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 888/1787] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:53.008711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc7f84b2c744b8f9f402998c51d6328'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.009562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc7f84b2c744b8f9f402998c51d6328'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.022350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:53.024190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:53.031013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc7f84b2c744b8f9f402998c51d6328'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.042385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504206aa-9fd0-4873-873d-ac04a03763dd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:53.048870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:53.050279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:53.050692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:53.051069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] PATH_INFO: `/v3/users/6127b09a3e5a47dd81f8fe012b541ba0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:53.052412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6127b09a3e5a47dd81f8fe012b541ba0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:53.054404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:53.058351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc7f84b2c744b8f9f402998c51d6328'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.068291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc7f84b2c744b8f9f402998c51d6328'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.076364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 900/1788] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:52 2022] DELETE /identity/v3/users/ccc7f84b2c744b8f9f402998c51d6328 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:53.111337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6127b09a3e5a47dd81f8fe012b541ba0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.111990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6127b09a3e5a47dd81f8fe012b541ba0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.112613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6127b09a3e5a47dd81f8fe012b541ba0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.123153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6127b09a3e5a47dd81f8fe012b541ba0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.135677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6127b09a3e5a47dd81f8fe012b541ba0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.148904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 889/1789] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:53 2022] DELETE /identity/v3/users/6127b09a3e5a47dd81f8fe012b541ba0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:05:53.425876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:53.427982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:53.440711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:53.537874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d5148-15ce-4711-bf9e-f5fc1c98f8a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:53.602647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:53.603677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:53.604055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:53.604442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] PATH_INFO: `/v3/projects/eb83fc328dde4a5f94c93f5e15e27795` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:53.605790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb83fc328dde4a5f94c93f5e15e27795)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:53.607817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:53.668279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb83fc328dde4a5f94c93f5e15e27795', 'request_id': 'req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.674301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb83fc328dde4a5f94c93f5e15e27795', 'request_id': 'req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.684669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:53.684876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb83fc328dde4a5f94c93f5e15e27795', 'request_id': 'req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.686611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:53.710864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] The token cache is being invalidate because project eb83fc328dde4a5f94c93f5e15e27795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:53.713177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31e182-a12a-4337-aaad-5ffdc2fb6f7b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:53.717436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.718931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.721242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 901/1790] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:53 2022] DELETE /identity/v3/projects/eb83fc328dde4a5f94c93f5e15e27795 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:53.725919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:53.727418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:53.775918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:53.800272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:53.808158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:53.809609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:53.810142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:53.810662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] PATH_INFO: `/v3/projects/80dcfb9850b14d4ea88c4417f5a81fc8` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:53.814590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=80dcfb9850b14d4ea88c4417f5a81fc8)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:53.818624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:53.819944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa8fa-1ab0-401b-ae4e-a2c143f7824c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:53.832923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:53.835464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:53.835822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:53.836166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] PATH_INFO: `/v3/users/f3025c53ec9441aab7767a5a6facac8f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:53.837769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3025c53ec9441aab7767a5a6facac8f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:53.840811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:53.887436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80dcfb9850b14d4ea88c4417f5a81fc8', 'request_id': 'req-74943c13-ee00-423d-a610-4544ed9c4cbb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.897632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80dcfb9850b14d4ea88c4417f5a81fc8', 'request_id': 'req-74943c13-ee00-423d-a610-4544ed9c4cbb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.907798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80dcfb9850b14d4ea88c4417f5a81fc8', 'request_id': 'req-74943c13-ee00-423d-a610-4544ed9c4cbb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.921194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] The token cache is being invalidate because project 80dcfb9850b14d4ea88c4417f5a81fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:53.921515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.922137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.924674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 890/1791] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:53 2022] DELETE /identity/v3/projects/80dcfb9850b14d4ea88c4417f5a81fc8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:53.928153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:53.929573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:53.929742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3025c53ec9441aab7767a5a6facac8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.930404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3025c53ec9441aab7767a5a6facac8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.942052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3025c53ec9441aab7767a5a6facac8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.957890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3025c53ec9441aab7767a5a6facac8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.965702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3025c53ec9441aab7767a5a6facac8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:53.972372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 902/1792] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:53 2022] DELETE /identity/v3/users/f3025c53ec9441aab7767a5a6facac8f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:54.011947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943c13-ee00-423d-a610-4544ed9c4cbb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.087388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.089147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.089689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.090150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] PATH_INFO: `/v3/users/a5e64417b85040fc9627fe481b49d2f1` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.091521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e64417b85040fc9627fe481b49d2f1)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.093644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.140451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:54.162308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e64417b85040fc9627fe481b49d2f1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.163032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e64417b85040fc9627fe481b49d2f1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.164114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e64417b85040fc9627fe481b49d2f1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.174930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e64417b85040fc9627fe481b49d2f1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.189471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-92a2ca49-f679-4f59-8ea6-d3e8a1f63f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e64417b85040fc9627fe481b49d2f1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.196143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.197840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:54.217130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 891/1793] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:53 2022] DELETE /identity/v3/users/a5e64417b85040fc9627fe481b49d2f1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:05:54.228358 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3be62-641f-4d1c-b0dd-7bfc13218d7d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.304804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3612-9303-4970-a687-3709504243fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.305845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3612-9303-4970-a687-3709504243fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.306228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3612-9303-4970-a687-3709504243fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.306593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3612-9303-4970-a687-3709504243fc admin admin] PATH_INFO: `/v3/projects/88f28cd782524f19a6a07daf15270a75` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.307897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3612-9303-4970-a687-3709504243fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f28cd782524f19a6a07daf15270a75)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.310139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3612-9303-4970-a687-3709504243fc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.366925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-585c3612-9303-4970-a687-3709504243fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f28cd782524f19a6a07daf15270a75', 'request_id': 'req-585c3612-9303-4970-a687-3709504243fc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.372393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-585c3612-9303-4970-a687-3709504243fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f28cd782524f19a6a07daf15270a75', 'request_id': 'req-585c3612-9303-4970-a687-3709504243fc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.380787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-585c3612-9303-4970-a687-3709504243fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f28cd782524f19a6a07daf15270a75', 'request_id': 'req-585c3612-9303-4970-a687-3709504243fc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.385382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:54.422687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-585c3612-9303-4970-a687-3709504243fc admin admin] The token cache is being invalidate because project 88f28cd782524f19a6a07daf15270a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:54.422975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-585c3612-9303-4970-a687-3709504243fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.423761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-585c3612-9303-4970-a687-3709504243fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.426290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 903/1794] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:54 2022] DELETE /identity/v3/projects/88f28cd782524f19a6a07daf15270a75 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:54.431192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.431484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.431764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.450745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:54.452066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:54.531278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 892/1795] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:54.541169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a0a0-b3fb-4f35-b330-3d27cc11d428 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.541731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a0a0-b3fb-4f35-b330-3d27cc11d428 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.542012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a0a0-b3fb-4f35-b330-3d27cc11d428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.554521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.555941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:54.568587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2759-c7a1-4e83-8e5c-fc4a05409c74 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.572793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-40e2a0a0-b3fb-4f35-b330-3d27cc11d428 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:54.573560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.574440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.574746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.574840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40e2a0a0-b3fb-4f35-b330-3d27cc11d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:54.575019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] PATH_INFO: `/v3/projects/0a4372f1f847476f8ddac467c2387606` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.576230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4372f1f847476f8ddac467c2387606)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.578243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.585102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 904/1796] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:54.590646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2a0a0-b3fb-4f35-b330-3d27cc11d428 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.613440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2a0a0-b3fb-4f35-b330-3d27cc11d428 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.618356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.619140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.619488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.619766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.620735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:54.621055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.622704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.639529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4372f1f847476f8ddac467c2387606', 'request_id': 'req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.640079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 905/1797] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:05:54.641075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.649398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4372f1f847476f8ddac467c2387606', 'request_id': 'req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.651718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d079df-1cec-4342-9afd-815d9e423dc1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.657246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4372f1f847476f8ddac467c2387606', 'request_id': 'req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.676457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] The token cache is being invalidate because project 0a4372f1f847476f8ddac467c2387606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:54.676825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.677557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7a5b14f8-7c61-4a12-9d7e-c62bfda50015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:54.679250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 893/1798] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:54 2022] DELETE /identity/v3/projects/0a4372f1f847476f8ddac467c2387606 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:54.686082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c34fdb-2662-44b7-9b81-3076187da82e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.686365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c34fdb-2662-44b7-9b81-3076187da82e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.686639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c34fdb-2662-44b7-9b81-3076187da82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.707887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d2c34fdb-2662-44b7-9b81-3076187da82e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:54.709140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d2c34fdb-2662-44b7-9b81-3076187da82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:54.720972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.721665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.722198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.722550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.723311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.725549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.744003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:54.755368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 906/1799] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:54.759657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.761559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:54.783249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 894/1800] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:54.791840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a05a-9314-49a9-bd13-1e525bf25f39 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.792129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a05a-9314-49a9-bd13-1e525bf25f39 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.792433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a05a-9314-49a9-bd13-1e525bf25f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.812579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d876a05a-9314-49a9-bd13-1e525bf25f39 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:54.813827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d876a05a-9314-49a9-bd13-1e525bf25f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:54.841440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a43fb1-48b5-4827-97d2-2ac9e9146630 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.846198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.846877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.847188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.847459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.848163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.850139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.876435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 907/1801] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:54.880320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.886868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 895/1802] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:54.888129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a05a-9314-49a9-bd13-1e525bf25f39 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.890685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb966-44dd-4433-91df-3c9b9aea9fbc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.895533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.896193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.896470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.896885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.897617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.899240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.899814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a05a-9314-49a9-bd13-1e525bf25f39 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.906287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.907180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.907559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.907957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.908834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:54.909347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.909884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 908/1803] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:54.911098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.913763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.924693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 896/1804] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:54.925695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd116019-3981-4843-b93c-7c41317fdedd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.928592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.931251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.931945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.932224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.932561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.933248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.934850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.949826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a2018-f73e-41fc-9a77-8f21b53743a8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.951167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 909/1805] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:54.952149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:54.956057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.956909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.957222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.957750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.959324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.961466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.963705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6b484-2550-4940-b3ef-6774ed2ae2c8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:54.968821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0128929-ccd3-44b1-bb5a-f29c3a288be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:54.969712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0128929-ccd3-44b1-bb5a-f29c3a288be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:54.969986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0128929-ccd3-44b1-bb5a-f29c3a288be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:54.970254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0128929-ccd3-44b1-bb5a-f29c3a288be8 admin admin] PATH_INFO: `/v3/projects/43b5761cfe5247ffa533531f0f701be6/users/965d3032535543a59ea00ddc22c4b60a/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:54.989630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0128929-ccd3-44b1-bb5a-f29c3a288be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b5761cfe5247ffa533531f0f701be6, user_id=965d3032535543a59ea00ddc22c4b60a, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:54.992223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 897/1806] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:54.992427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0128929-ccd3-44b1-bb5a-f29c3a288be8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:54.997632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.012861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 910/1807] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:54 2022] PUT /identity/v3/projects/43b5761cfe5247ffa533531f0f701be6/users/965d3032535543a59ea00ddc22c4b60a/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:55.024471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe2177-f0a2-4e60-be2a-e91679d0a32e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.024844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe2177-f0a2-4e60-be2a-e91679d0a32e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.025123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe2177-f0a2-4e60-be2a-e91679d0a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.031746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:55.051938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-89fe2177-f0a2-4e60-be2a-e91679d0a32e None None] MFA Rules not processed for user `965d3032535543a59ea00ddc22c4b60a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:55.053165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-89fe2177-f0a2-4e60-be2a-e91679d0a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:55.079717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73df90-17d9-4d74-a464-257f77c2dc58 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.131206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:55.133294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 911/1808] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:55.137873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe2177-f0a2-4e60-be2a-e91679d0a32e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.146320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.147024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.147431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.148145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.148860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.151253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.182052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 898/1809] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:54 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:55.183197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.195985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963395d8-21c6-406c-8ed7-3b4711389607 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.201679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.202541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.202824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.203093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.203828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.205516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.214555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe2177-f0a2-4e60-be2a-e91679d0a32e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.218507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 899/1810] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:55.222117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.222504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.222971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.223326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.223668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.224519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.226742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.233349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8a3e5-ffb9-4cec-8caf-47ecad0468bf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.237257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.237958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.238233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.238506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.239226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.240840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.251923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 900/1811] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:55.256203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.260343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 912/1812] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:55 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:55.261400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.267080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed18a-dcdf-46c4-9fbd-858eb0dfb296 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.335678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cc312-7fae-45d5-a2d2-f8bbae4c10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.336731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cc312-7fae-45d5-a2d2-f8bbae4c10aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.337019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cc312-7fae-45d5-a2d2-f8bbae4c10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.337418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cc312-7fae-45d5-a2d2-f8bbae4c10aa admin admin] PATH_INFO: `/v3/projects/d80bc1bb98924a208eb2b5d0d1e6650a/users/d365d3012ec6434296af2578e8bfbe52/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.340050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6505922-5487-4a5f-b033-dab292623694 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.346193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.346193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.346439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.346809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.347647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.349648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.354086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cc312-7fae-45d5-a2d2-f8bbae4c10aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80bc1bb98924a208eb2b5d0d1e6650a, user_id=d365d3012ec6434296af2578e8bfbe52, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.356917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cc312-7fae-45d5-a2d2-f8bbae4c10aa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.372277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 901/1813] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:55 2022] PUT /identity/v3/projects/d80bc1bb98924a208eb2b5d0d1e6650a/users/d365d3012ec6434296af2578e8bfbe52/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:05:55.376300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 913/1814] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:55 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:55.377012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.377323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.377434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.377599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.387491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a488a-77bd-43ab-8e28-188004349c89 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.392612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:55.395710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:55.397032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:55.454327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.455598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.456075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.456531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.457910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.459901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.473046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 914/1815] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:55.477149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.483220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 902/1816] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:55.489185 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394c89e-9d7d-4a25-b3d8-d661d754d6a4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.494451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.495753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:55.497320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.498355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.498659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.498915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] PATH_INFO: `/v3/projects/e8a0d619d9a84ed5a90a24bada0d826e/users/3f99766e71f14e319cf6876661c41820/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.518729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a0d619d9a84ed5a90a24bada0d826e, user_id=3f99766e71f14e319cf6876661c41820, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.521572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.536714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 915/1817] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:55 2022] PUT /identity/v3/projects/e8a0d619d9a84ed5a90a24bada0d826e/users/3f99766e71f14e319cf6876661c41820/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:55.541337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.547435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:55.565843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2923-0ea4-4884-9bb6-aad789074e59 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.608619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2acbf-a61d-4bb7-94bc-41c8337efb2e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.614139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.614822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.615098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.615364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.616090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.617725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.620869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347abc21-8ddc-491b-bcf0-693bf673da54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.621676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347abc21-8ddc-491b-bcf0-693bf673da54 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.621955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347abc21-8ddc-491b-bcf0-693bf673da54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.622240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347abc21-8ddc-491b-bcf0-693bf673da54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.629866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 916/1818] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:55.633970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.635871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347abc21-8ddc-491b-bcf0-693bf673da54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.637386 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347abc21-8ddc-491b-bcf0-693bf673da54 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.646511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feda42-b4f7-417b-9f50-fd870a374d18 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.648293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 903/1819] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:55.652756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.653887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.654123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.654394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] PATH_INFO: `/v3/projects/e8a0d619d9a84ed5a90a24bada0d826e/users/3f99766e71f14e319cf6876661c41820/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.656390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a0d619d9a84ed5a90a24bada0d826e, user_id=3f99766e71f14e319cf6876661c41820, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.659257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.670280 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 917/1820] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:55 2022] PUT /identity/v3/projects/e8a0d619d9a84ed5a90a24bada0d826e/users/3f99766e71f14e319cf6876661c41820/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:55.680510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf624d-3960-4fdd-b259-066b426a529b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.680840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf624d-3960-4fdd-b259-066b426a529b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.681086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf624d-3960-4fdd-b259-066b426a529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.727116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bbdf624d-3960-4fdd-b259-066b426a529b None None] MFA Rules not processed for user `3f99766e71f14e319cf6876661c41820`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:55.728144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bbdf624d-3960-4fdd-b259-066b426a529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:55.820926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 904/1821] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:55.831242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:55.833958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:55.929376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402983a-11d0-4c2c-9237-db68c2b7dd2e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:55.933969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:55.934614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:55.935028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:55.935303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:55.945520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:55.946966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:55.958375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 918/1822] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:56.535752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352b65-2228-44b1-955e-f06a42b1dd55 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:56.536730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352b65-2228-44b1-955e-f06a42b1dd55 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:56.537017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352b65-2228-44b1-955e-f06a42b1dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:56.569002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-46352b65-2228-44b1-955e-f06a42b1dd55 None None] MFA Rules not processed for user `d365d3012ec6434296af2578e8bfbe52`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:56.570783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-46352b65-2228-44b1-955e-f06a42b1dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:56.660754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 905/1823] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:56.662571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:56.672786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:56.740599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ebf12-50c2-41cb-871b-4852c2d7cae2 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:56.745466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:56.746165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:56.746445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:56.746721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:56.747411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:56.749371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:56.776874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 919/1824] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:05:56 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:56.780669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46352b65-2228-44b1-955e-f06a42b1dd55 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:56.791498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46352b65-2228-44b1-955e-f06a42b1dd55 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:56.799826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:56.850380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:56.851195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:56.851472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:56.851741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:56.852439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:56.854407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:56.876534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 906/1825] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:05:56 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:05:56.880619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:56.894804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81521577-4f12-4083-9ef2-652dc3916f3c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:56.899587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:56.900380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:56.900763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:56.901101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:56.902086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:56.903665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:56.916702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 920/1826] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:56.919935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:56.932831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542080a-2e04-4820-87a8-2c40d8b65328 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:56.937785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:56.939580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:56.939865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:56.940135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] PATH_INFO: `/v3/projects/474c5873ab4045d99970d6526dcf4c3a/users/f846d0150fda416aab08775461e16a5a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:56.956778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474c5873ab4045d99970d6526dcf4c3a, user_id=f846d0150fda416aab08775461e16a5a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:56.959608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:56.977342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 907/1827] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:56 2022] PUT /identity/v3/projects/474c5873ab4045d99970d6526dcf4c3a/users/f846d0150fda416aab08775461e16a5a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:56.981171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:56.993289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2184-68ad-4ec0-803c-dca1b9e8076e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:57.066348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:57.067819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:57.067819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:57.067819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:57.068988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:57.071003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:57.087734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 921/1828] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:57.094031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:57.105497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef322939-c3b3-4366-9f84-9a5bdc3736f2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:57.110745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798710-4223-4149-a417-fbd5b603fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:57.112106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798710-4223-4149-a417-fbd5b603fbd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:57.112391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798710-4223-4149-a417-fbd5b603fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:57.112742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798710-4223-4149-a417-fbd5b603fbd9 admin admin] PATH_INFO: `/v3/projects/474c5873ab4045d99970d6526dcf4c3a/users/f846d0150fda416aab08775461e16a5a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:57.114789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798710-4223-4149-a417-fbd5b603fbd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474c5873ab4045d99970d6526dcf4c3a, user_id=f846d0150fda416aab08775461e16a5a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:57.117544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798710-4223-4149-a417-fbd5b603fbd9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:57.138261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 908/1829] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:05:57 2022] PUT /identity/v3/projects/474c5873ab4045d99970d6526dcf4c3a/users/f846d0150fda416aab08775461e16a5a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:57.654495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:57.668349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8717b-baf6-4348-9c48-c063494f5a4f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:57.789978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:57.791401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:57.791767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:57.791967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] PATH_INFO: `/v3/users/965d3032535543a59ea00ddc22c4b60a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:57.793833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=965d3032535543a59ea00ddc22c4b60a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:57.796820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:57.843332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:57.893157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965d3032535543a59ea00ddc22c4b60a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:57.894789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965d3032535543a59ea00ddc22c4b60a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:57.914299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965d3032535543a59ea00ddc22c4b60a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:57.927849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965d3032535543a59ea00ddc22c4b60a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:57.935146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965d3032535543a59ea00ddc22c4b60a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:57.941602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 922/1830] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:57 2022] DELETE /identity/v3/users/965d3032535543a59ea00ddc22c4b60a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:57.946508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f68df-628d-4bc3-80bc-b3d0ebbd766c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:57.946964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f68df-628d-4bc3-80bc-b3d0ebbd766c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:57.947342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f68df-628d-4bc3-80bc-b3d0ebbd766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:57.965286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e13f68df-628d-4bc3-80bc-b3d0ebbd766c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:57.966484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e13f68df-628d-4bc3-80bc-b3d0ebbd766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.028018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 909/1831] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:58.038335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:58.040237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.080512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:58.080902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:58.081478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:58.113220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] MFA Rules not processed for user `f846d0150fda416aab08775461e16a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:58.114554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.115658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd6a8e-3aea-4776-96b2-6bb0bf76c8ea admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:58.121267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:58.122230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:58.122513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:58.122789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:58.136199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:58.138084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:58.152211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 923/1832] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:58.193181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:58.221548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 910/1833] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:58.235985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:58.237445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.359515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefadd3-c9da-4375-a3c3-3007ac48fe94 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:58.364489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:58.365320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:58.365741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:58.366107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:58.373470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.492716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:58.505515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:58.507698 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:58.539092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 924/1834] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:58.611863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:58.613562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.638551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966d2c-bfe9-42b6-9f5d-24b27934b4bf None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:58.644911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:58.647387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:58.647815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:58.648257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] PATH_INFO: `/v3/users/3f1f93f7aadb4eff9416a339b63d7793` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:58.650146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1f93f7aadb4eff9416a339b63d7793)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:58.653253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:58.687849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:58.689390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.721374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35269764-ab4d-45c1-8266-6b95f77ce220 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:58.727448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:58.728905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:58.730002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:58.730484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] PATH_INFO: `/v3/projects/43b5761cfe5247ffa533531f0f701be6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:58.732342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b5761cfe5247ffa533531f0f701be6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:58.735302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:58.789296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1f93f7aadb4eff9416a339b63d7793'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.790184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1f93f7aadb4eff9416a339b63d7793'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.790982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1f93f7aadb4eff9416a339b63d7793'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.811706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1f93f7aadb4eff9416a339b63d7793'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.829783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b5761cfe5247ffa533531f0f701be6', 'request_id': 'req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.831736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c101ce64-a8e0-460d-b520-49d74442bae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1f93f7aadb4eff9416a339b63d7793'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.858539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b5761cfe5247ffa533531f0f701be6', 'request_id': 'req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.872751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b5761cfe5247ffa533531f0f701be6', 'request_id': 'req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.874111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 911/1835] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:58 2022] DELETE /identity/v3/users/3f1f93f7aadb4eff9416a339b63d7793 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:58.880093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:58.880454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:58.880888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:58.909722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] The token cache is being invalidate because project 43b5761cfe5247ffa533531f0f701be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:58.910080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.912173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:58.918338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 925/1836] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:05:58 2022] DELETE /identity/v3/projects/43b5761cfe5247ffa533531f0f701be6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:58.920537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:58.924172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:58.935372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:58.942829 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:59.110612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 912/1837] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:59.122967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:59.125420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:59.142072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bbe4e-cde5-459f-8a4f-ca5b03a9f23a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:59.156151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:59.157997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:59.159045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:59.159450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] PATH_INFO: `/v3/users/3f99766e71f14e319cf6876661c41820` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:59.163632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f99766e71f14e319cf6876661c41820)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:59.165811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:59.278932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326609a-4ebe-46fa-821f-11a118750334 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:59.292683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:59.293616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:59.294117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:59.294588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:59.311345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:59.316439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:59.318341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f99766e71f14e319cf6876661c41820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:59.319050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f99766e71f14e319cf6876661c41820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:59.336368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f99766e71f14e319cf6876661c41820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:59.345592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 913/1838] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:05:59.373999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f99766e71f14e319cf6876661c41820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:59.392964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:59.402722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-54b8949d-c263-4ca7-be18-841863bbe8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f99766e71f14e319cf6876661c41820'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:59.437963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 926/1839] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:05:58 2022] DELETE /identity/v3/users/3f99766e71f14e319cf6876661c41820 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:00.249977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:00.251562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:00.259952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:00.351310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550496e8-d3eb-4230-bd26-5c74fc7d4603 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:00.462845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc0bb3-8440-4fdb-b772-befc65d86551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:00.463642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc0bb3-8440-4fdb-b772-befc65d86551 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:00.463927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc0bb3-8440-4fdb-b772-befc65d86551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:00.464205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc0bb3-8440-4fdb-b772-befc65d86551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:00.466199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-40cc0bb3-8440-4fdb-b772-befc65d86551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:00.595720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc0bb3-8440-4fdb-b772-befc65d86551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:00.599180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc0bb3-8440-4fdb-b772-befc65d86551 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:00.607327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8fd33-84d2-4ebb-b467-47a805ed6891 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:00.607841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8fd33-84d2-4ebb-b467-47a805ed6891 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:00.607947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8fd33-84d2-4ebb-b467-47a805ed6891 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:00.610219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 927/1840] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 12:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:06:00.621419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8fd33-84d2-4ebb-b467-47a805ed6891 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:00.623391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b7f8fd33-84d2-4ebb-b467-47a805ed6891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:00.631244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 914/1841] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:00.788455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8fd33-84d2-4ebb-b467-47a805ed6891 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:00.791955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:00.792825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:00.793111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:00.793423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] PATH_INFO: `/v3/projects/f58cdb4208064cc49a0dfa94cf8e0778` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:00.794652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58cdb4208064cc49a0dfa94cf8e0778)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:00.796822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:00.850585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:00.851195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:00.851475 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:00.885136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:00.886515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:00.939539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58cdb4208064cc49a0dfa94cf8e0778', 'request_id': 'req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:00.954198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58cdb4208064cc49a0dfa94cf8e0778', 'request_id': 'req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:00.985137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58cdb4208064cc49a0dfa94cf8e0778', 'request_id': 'req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.015414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] The token cache is being invalidate because project f58cdb4208064cc49a0dfa94cf8e0778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:01.015414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.016220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.021525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 928/1842] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:00 2022] DELETE /identity/v3/projects/f58cdb4208064cc49a0dfa94cf8e0778 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:01.022594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:01.025807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:01.093194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 915/1843] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:01.094071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:01.097150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:01.102872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:01.199024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe9b4-ccad-4483-a435-cf8ed0c282ec admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:01.204896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:01.206424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:01.206704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:01.206977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] PATH_INFO: `/v3/projects/e8a0d619d9a84ed5a90a24bada0d826e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:01.208375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a0d619d9a84ed5a90a24bada0d826e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:01.210649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:01.258039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae762c-5381-4a9f-8aed-a1577b5e1ed8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:01.269964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:01.271001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:01.271382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:01.271866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] PATH_INFO: `/v3/users/af0547d8f74f4470b0bb84d5b7bf4699` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:01.273277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0547d8f74f4470b0bb84d5b7bf4699)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:01.275440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:01.326387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:01.345416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a0d619d9a84ed5a90a24bada0d826e', 'request_id': 'req-19d583c2-185c-40c2-ab27-ee815b8e3f12'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.350307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0547d8f74f4470b0bb84d5b7bf4699'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.351849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0547d8f74f4470b0bb84d5b7bf4699'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.352145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a0d619d9a84ed5a90a24bada0d826e', 'request_id': 'req-19d583c2-185c-40c2-ab27-ee815b8e3f12'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.352789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0547d8f74f4470b0bb84d5b7bf4699'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.360992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a0d619d9a84ed5a90a24bada0d826e', 'request_id': 'req-19d583c2-185c-40c2-ab27-ee815b8e3f12'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.365415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0547d8f74f4470b0bb84d5b7bf4699'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.387138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e87a07b-f959-4769-9a2a-6ca2437ed6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0547d8f74f4470b0bb84d5b7bf4699'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.391133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] The token cache is being invalidate because project e8a0d619d9a84ed5a90a24bada0d826e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:01.391564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.392363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:01.403906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 929/1844] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:01 2022] DELETE /identity/v3/projects/e8a0d619d9a84ed5a90a24bada0d826e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:01.403906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:01.403906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:01.413214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 916/1845] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:01 2022] DELETE /identity/v3/users/af0547d8f74f4470b0bb84d5b7bf4699 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:01.415375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a7c7-793f-45f8-bce2-56285f4764c0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:01.415842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a7c7-793f-45f8-bce2-56285f4764c0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:01.430211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a7c7-793f-45f8-bce2-56285f4764c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:01.474439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a1d5a7c7-793f-45f8-bce2-56285f4764c0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:01.480022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a1d5a7c7-793f-45f8-bce2-56285f4764c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:01.541391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d583c2-185c-40c2-ab27-ee815b8e3f12 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:01.621675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 917/1846] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:01.631234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea1f3-152d-4ea4-8a43-28c8914a3131 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:01.631846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea1f3-152d-4ea4-8a43-28c8914a3131 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:01.632392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea1f3-152d-4ea4-8a43-28c8914a3131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:01.667055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-df6ea1f3-152d-4ea4-8a43-28c8914a3131 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:01.668410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:01.669550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-df6ea1f3-152d-4ea4-8a43-28c8914a3131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:01.669658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:01.669942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:01.670701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:01.675477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:01.685015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 918/1847] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:01.690742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea1f3-152d-4ea4-8a43-28c8914a3131 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:01.707622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:01.711181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:01.713333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea1f3-152d-4ea4-8a43-28c8914a3131 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:01.731283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 930/1848] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:01.731817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:01.732877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:01.733338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:01.733824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:01.736194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:01.736514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:01.739329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:01.762974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:01.763233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 919/1849] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:01.783235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1edeb-e858-4963-b186-14df373e7dee service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:01.789718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:01.790454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:01.790836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:01.791119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:01.791891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:01.793940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:01.879364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 931/1850] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:01 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:01.888736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:01.896275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:01.913576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b9d6b-492b-4d32-b747-012d6d6f6723 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:01.994406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:01.996538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:02.055442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:02.131935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:02.132683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.133124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.133645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.134734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:02.139158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:02.185961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d93ef-7df9-4734-b9c8-24bf586d8baa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:02.200076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 920/1851] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:01 2022] POST /identity/v3/users => generated 291 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:02.203082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:02.210316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:02.211639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.213022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.213487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] PATH_INFO: `/v3/projects/84c3c11173524d66aff911168774c5c6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.228281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c3c11173524d66aff911168774c5c6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:02.230799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:02.256955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76219809-fd5e-4b1d-a8b3-a1778599159d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:02.264162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:02.265166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.265334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.265559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.266400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:02.268089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:02.291719 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 921/1852] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:02.292799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:02.342421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9af969-6bff-405b-b215-4e4cf69eac04 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:02.349144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c3c11173524d66aff911168774c5c6', 'request_id': 'req-7df3cab6-9518-4500-ab66-bfc5302f9074'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:02.360793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c3c11173524d66aff911168774c5c6', 'request_id': 'req-7df3cab6-9518-4500-ab66-bfc5302f9074'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:02.380687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c3c11173524d66aff911168774c5c6', 'request_id': 'req-7df3cab6-9518-4500-ab66-bfc5302f9074'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:02.423737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] The token cache is being invalidate because project 84c3c11173524d66aff911168774c5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:02.424472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:02.425698 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7df3cab6-9518-4500-ab66-bfc5302f9074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:02.431083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 932/1853] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:01 2022] DELETE /identity/v3/projects/84c3c11173524d66aff911168774c5c6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:02.437963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216a09-1265-47c2-a414-b5bd5990784f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.438254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216a09-1265-47c2-a414-b5bd5990784f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.438535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3216a09-1265-47c2-a414-b5bd5990784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.483759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a3216a09-1265-47c2-a414-b5bd5990784f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:02.485130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a3216a09-1265-47c2-a414-b5bd5990784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:02.617093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:02.617790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.618070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.618347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.619091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:02.620737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:02.657821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 922/1854] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:02.661934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:02.665367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:02.690635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 933/1855] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:02.698769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41308ed0-3aaa-4939-98d1-73da95d63641 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.698769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41308ed0-3aaa-4939-98d1-73da95d63641 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.699106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41308ed0-3aaa-4939-98d1-73da95d63641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.708882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc325d-338b-49d3-a4d1-26de78709681 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:02.720454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b788666-2139-4d44-9fba-e35622f80d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:02.726164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b788666-2139-4d44-9fba-e35622f80d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.727300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b788666-2139-4d44-9fba-e35622f80d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.728320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b788666-2139-4d44-9fba-e35622f80d02 admin admin] PATH_INFO: `/v3/projects/75e49ffc48614dd1a5310b0c0c771c9d/users/3537b9c4486b44468780951618642630/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.757689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-41308ed0-3aaa-4939-98d1-73da95d63641 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:02.757689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41308ed0-3aaa-4939-98d1-73da95d63641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:02.784235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 934/1856] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:02.793702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41308ed0-3aaa-4939-98d1-73da95d63641 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:02.814434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41308ed0-3aaa-4939-98d1-73da95d63641 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:02.815725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b788666-2139-4d44-9fba-e35622f80d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e49ffc48614dd1a5310b0c0c771c9d, user_id=3537b9c4486b44468780951618642630, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:02.820210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b788666-2139-4d44-9fba-e35622f80d02 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:02.834658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:02.836834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.837138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.837421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.840790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:02.841133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:02.848583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:02.858762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 923/1857] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:02 2022] PUT /identity/v3/projects/75e49ffc48614dd1a5310b0c0c771c9d/users/3537b9c4486b44468780951618642630/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:02.870296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40675b20-3adf-44c4-9b29-5e879b6d0b58 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.871098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40675b20-3adf-44c4-9b29-5e879b6d0b58 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.871958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40675b20-3adf-44c4-9b29-5e879b6d0b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.877259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 935/1858] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:06:02.878463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:02.890810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4877c-c1b8-405b-8739-2fc8bcf6439d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:02.925815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:02.951984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-40675b20-3adf-44c4-9b29-5e879b6d0b58 None None] MFA Rules not processed for user `3537b9c4486b44468780951618642630`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:02.954684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-40675b20-3adf-44c4-9b29-5e879b6d0b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:02.970706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:02.971405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:02.971746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:02.972153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:02.973047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:02.975508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.016910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 936/1859] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:02 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:03.021570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.029174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:03.086818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 924/1860] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:03.092750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40675b20-3adf-44c4-9b29-5e879b6d0b58 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.106249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40675b20-3adf-44c4-9b29-5e879b6d0b58 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.154873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9d76-337c-496a-9f21-057c2af12f71 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.160837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.161532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.161818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.162094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.163808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.165641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.200678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 937/1861] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:03 2022] POST /identity/v3/users => generated 305 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:03.207522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.239816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623624-99bc-406f-b410-30e0a39e9414 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.242354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.245240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.246491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.247279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.248123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.253027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.254756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.256631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.258267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.258601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.260387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.263105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.298521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 938/1862] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:03.311616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.325478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601646-4caa-4c54-ab7e-80cf36959cf2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.337041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.337597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.338267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.340560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.341991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.344973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.348762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 925/1863] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:03 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:03.352507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.368866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 939/1864] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:03.370360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.383022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f659dc-3b83-49e5-b58d-cf024bc14b4e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.450539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ffefa-ec36-432b-914f-5bada7ce4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.451726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ffefa-ec36-432b-914f-5bada7ce4940 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.452137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ffefa-ec36-432b-914f-5bada7ce4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.452373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98953a-c6c4-4cdf-9439-519619a2441a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.452600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ffefa-ec36-432b-914f-5bada7ce4940 admin admin] PATH_INFO: `/v3/projects/d2328dcf5fa1414aa9bcd8a8bfe9caef/users/de45f7487f1d49cfa9c3b71af4eecf8f/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.459695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.460485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.460782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.461006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.461956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.464445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.485895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ffefa-ec36-432b-914f-5bada7ce4940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2328dcf5fa1414aa9bcd8a8bfe9caef, user_id=de45f7487f1d49cfa9c3b71af4eecf8f, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.489440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ffefa-ec36-432b-914f-5bada7ce4940 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.497617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 926/1865] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:03 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:03.502461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.515058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742390-2158-4ec4-b8cf-5c51d8753752 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.516681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 940/1866] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:03 2022] PUT /identity/v3/projects/d2328dcf5fa1414aa9bcd8a8bfe9caef/users/de45f7487f1d49cfa9c3b71af4eecf8f/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:03.531871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858bd9-f579-4cf5-a80a-48629c89ffda None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.532158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858bd9-f579-4cf5-a80a-48629c89ffda None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.532437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f858bd9-f579-4cf5-a80a-48629c89ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.541660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:03.571146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6f858bd9-f579-4cf5-a80a-48629c89ffda None None] MFA Rules not processed for user `de45f7487f1d49cfa9c3b71af4eecf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:03.572240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f858bd9-f579-4cf5-a80a-48629c89ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:03.664413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:03.681984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.685389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.685874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.686321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.687290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.689262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.711488 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 927/1867] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:03.713107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.715158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 941/1868] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:03.720088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f858bd9-f579-4cf5-a80a-48629c89ffda None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.727521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fd6c0-217c-4338-adf7-d6c741153b3f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.732224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.733581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.733867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.734528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] PATH_INFO: `/v3/projects/01dd2af5fd374ebdb3413b25fee9d6c6/users/4aadbc97b2ef4de398b4e87f9fda96bd/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.759464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dd2af5fd374ebdb3413b25fee9d6c6, user_id=4aadbc97b2ef4de398b4e87f9fda96bd, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.760050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f858bd9-f579-4cf5-a80a-48629c89ffda None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:03.762502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.776004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:03.776932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:03.777418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:03.777799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:03.778700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:03.781881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:03.816968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 928/1869] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:03 2022] PUT /identity/v3/projects/01dd2af5fd374ebdb3413b25fee9d6c6/users/4aadbc97b2ef4de398b4e87f9fda96bd/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:03.818027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:03.868859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 942/1870] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:03 2022] POST /identity/v3/projects => generated 407 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:03.874721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:04.019653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a222ca-6cf3-4751-b5a2-6c02e0606027 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.066151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222fb23-9c0a-47e8-bfd2-752211e26a64 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.076381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:04.077303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.077657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.079096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.079942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:04.082496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:04.147702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 943/1871] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:03 2022] POST /identity/v3/users => generated 310 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:04.148911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:04.168458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:04.169225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.169508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.169826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.170161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e88319-3851-4ff5-a772-a9a98782a515 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.170571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:04.176247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:04.187220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:04.188113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.188827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.188827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.189438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:04.191568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:04.201851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 929/1872] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:04.203467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:04.216526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 944/1873] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:04.218390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26f116-ba3b-40ed-ad8f-ad8436b17a1f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.220956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:04.224713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a0ffa-0d9c-430c-8f89-46fcf0f31605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:04.225746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0ffa-0d9c-430c-8f89-46fcf0f31605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.226094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0ffa-0d9c-430c-8f89-46fcf0f31605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.227222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0ffa-0d9c-430c-8f89-46fcf0f31605 admin admin] PATH_INFO: `/v3/projects/01dd2af5fd374ebdb3413b25fee9d6c6/users/4aadbc97b2ef4de398b4e87f9fda96bd/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.229893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a0ffa-0d9c-430c-8f89-46fcf0f31605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dd2af5fd374ebdb3413b25fee9d6c6, user_id=4aadbc97b2ef4de398b4e87f9fda96bd, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:04.233225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a0ffa-0d9c-430c-8f89-46fcf0f31605 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:04.256481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 930/1874] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:04 2022] PUT /identity/v3/projects/01dd2af5fd374ebdb3413b25fee9d6c6/users/4aadbc97b2ef4de398b4e87f9fda96bd/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:04.268139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159e0ec-566a-4fc0-8d55-7807a4509d02 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.270155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d74e-3a20-4583-aeff-c537581ebe04 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.270541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d74e-3a20-4583-aeff-c537581ebe04 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.270946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d74e-3a20-4583-aeff-c537581ebe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.367487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ea52d74e-3a20-4583-aeff-c537581ebe04 None None] MFA Rules not processed for user `4aadbc97b2ef4de398b4e87f9fda96bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:04.369068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ea52d74e-3a20-4583-aeff-c537581ebe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:04.433082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:04.460176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:04.461182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.461567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.461944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] PATH_INFO: `/v3/projects/8d6b4d3b2e434db29179643bc9fc5037/users/36773024e3474ceb98ee7683ada8c4d9/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.512627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:04.526243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6b4d3b2e434db29179643bc9fc5037, user_id=36773024e3474ceb98ee7683ada8c4d9, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:04.532705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:04.567092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 945/1875] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:04 2022] PUT /identity/v3/projects/8d6b4d3b2e434db29179643bc9fc5037/users/36773024e3474ceb98ee7683ada8c4d9/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:04.570934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:04.608709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 931/1876] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:04.743701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd134d2f-248d-4581-b25b-d5d99ba04176 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.764951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:04.765862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.766394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.766805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.767904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:04.770879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:04.784985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 946/1877] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:04.789110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d74e-3a20-4583-aeff-c537581ebe04 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:04.798880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:04.806904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:04.810299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52d74e-3a20-4583-aeff-c537581ebe04 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.818852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05f18c-5a54-4231-ab70-c60646197771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:04.819877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f18c-5a54-4231-ab70-c60646197771 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.820342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f18c-5a54-4231-ab70-c60646197771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.820836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f18c-5a54-4231-ab70-c60646197771 admin admin] PATH_INFO: `/v3/projects/8d6b4d3b2e434db29179643bc9fc5037/users/36773024e3474ceb98ee7683ada8c4d9/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.828416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05f18c-5a54-4231-ab70-c60646197771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6b4d3b2e434db29179643bc9fc5037, user_id=36773024e3474ceb98ee7683ada8c4d9, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:04.831544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05f18c-5a54-4231-ab70-c60646197771 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:04.856938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 932/1878] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:04 2022] PUT /identity/v3/projects/8d6b4d3b2e434db29179643bc9fc5037/users/36773024e3474ceb98ee7683ada8c4d9/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:04.872382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:04.872786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:04.873165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:04.916715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fbe51-6c2d-4c4f-b8a3-e83d2a2ccfaf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:04.928612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] MFA Rules not processed for user `36773024e3474ceb98ee7683ada8c4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:04.930034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:05.039773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:05.043366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:05.043741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:05.044089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:05.088615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 933/1879] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:04 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:05.104469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:05.106316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:05.120899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963fbaa-ae05-454b-b08c-407185de533c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:05.127507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:05.129482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:05.129987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:05.130332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:05.144958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:05.149648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:05.151703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:05.162583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 934/1880] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:05 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:05.169691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:05.171008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:05.181502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 947/1881] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:05.364924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:05.383440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b723a0c-8a1c-4371-9c89-e4b83d3f65d9 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:05.387965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e788-09f0-47da-9d0c-ad9ea206dd8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:05.389003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e788-09f0-47da-9d0c-ad9ea206dd8c service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:05.389818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e788-09f0-47da-9d0c-ad9ea206dd8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:05.390269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e788-09f0-47da-9d0c-ad9ea206dd8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:05.485642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e788-09f0-47da-9d0c-ad9ea206dd8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:05.487531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e788-09f0-47da-9d0c-ad9ea206dd8c service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:05.525284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 935/1882] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:05.768590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:05.904373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf4781-468a-4288-bd21-410f9f1d5026 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:05.909642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:05.910825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:05.911234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:05.911629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] PATH_INFO: `/v3/users/3537b9c4486b44468780951618642630` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:05.914504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3537b9c4486b44468780951618642630)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:05.922516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:06.035487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3537b9c4486b44468780951618642630'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.042383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3537b9c4486b44468780951618642630'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.058407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3537b9c4486b44468780951618642630'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.079910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3537b9c4486b44468780951618642630'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.091747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3537b9c4486b44468780951618642630'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.108448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 948/1883] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:05 2022] DELETE /identity/v3/users/3537b9c4486b44468780951618642630 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:06.113012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:06.113832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:06.114278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:06.149193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:06.150493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:06.201391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:06.246545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 936/1884] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:06.260620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:06.262131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:06.365112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05dea1-e18f-49d8-a282-6be8181cdeab admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:06.371653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:06.373099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:06.373405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:06.375773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:06.389663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:06.391817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:06.397370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:06.408292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 949/1885] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:06.785474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:06.787859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:06.807635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4b48d-7a03-48e4-8b62-d72f04b9ca9d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:06.813146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:06.815363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:06.815942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:06.816487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] PATH_INFO: `/v3/projects/75e49ffc48614dd1a5310b0c0c771c9d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:06.818746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e49ffc48614dd1a5310b0c0c771c9d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:06.821525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:06.892561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e49ffc48614dd1a5310b0c0c771c9d', 'request_id': 'req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.900177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e49ffc48614dd1a5310b0c0c771c9d', 'request_id': 'req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.906828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e49ffc48614dd1a5310b0c0c771c9d', 'request_id': 'req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.923783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] The token cache is being invalidate because project 75e49ffc48614dd1a5310b0c0c771c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:06.924066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.924766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:06.926327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 937/1886] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:06 2022] DELETE /identity/v3/projects/75e49ffc48614dd1a5310b0c0c771c9d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:06.930321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:06.940521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a85a28-0555-41eb-9a03-566aa789d718 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:07.000745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:07.001632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:07.001909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:07.002213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] PATH_INFO: `/v3/users/4aadbc97b2ef4de398b4e87f9fda96bd` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:07.003498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aadbc97b2ef4de398b4e87f9fda96bd)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:07.005531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:07.082927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aadbc97b2ef4de398b4e87f9fda96bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.083823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aadbc97b2ef4de398b4e87f9fda96bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.093019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aadbc97b2ef4de398b4e87f9fda96bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.106151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aadbc97b2ef4de398b4e87f9fda96bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.113486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0516a75f-9723-4951-9d18-91d02d6a74ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aadbc97b2ef4de398b4e87f9fda96bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.125014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 950/1887] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:06 2022] DELETE /identity/v3/users/4aadbc97b2ef4de398b4e87f9fda96bd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:07.474218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:07.475693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:07.488276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dd1e0-0367-4f69-b2e5-2badccd1bf9c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:07.570219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:07.571125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:07.571406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:07.571681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] PATH_INFO: `/v3/projects/01dd2af5fd374ebdb3413b25fee9d6c6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:07.573570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01dd2af5fd374ebdb3413b25fee9d6c6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:07.575487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:07.630537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01dd2af5fd374ebdb3413b25fee9d6c6', 'request_id': 'req-006dca8c-b5ad-405e-99bc-dd729db83555'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.639862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01dd2af5fd374ebdb3413b25fee9d6c6', 'request_id': 'req-006dca8c-b5ad-405e-99bc-dd729db83555'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.646401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01dd2af5fd374ebdb3413b25fee9d6c6', 'request_id': 'req-006dca8c-b5ad-405e-99bc-dd729db83555'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.650491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:07.663962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] The token cache is being invalidate because project 01dd2af5fd374ebdb3413b25fee9d6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:07.664527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.665457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-006dca8c-b5ad-405e-99bc-dd729db83555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:07.670481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 938/1888] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:07 2022] DELETE /identity/v3/projects/01dd2af5fd374ebdb3413b25fee9d6c6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:07.672517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4505fad-3964-4b94-b70c-2744b098a584 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:07.672907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4505fad-3964-4b94-b70c-2744b098a584 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:07.673241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4505fad-3964-4b94-b70c-2744b098a584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:07.700821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d4505fad-3964-4b94-b70c-2744b098a584 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:07.702116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d4505fad-3964-4b94-b70c-2744b098a584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:07.772295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 951/1889] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:07.783746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbeb0-a1a9-434c-a6ff-4332cb85d9d0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:07.784128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbeb0-a1a9-434c-a6ff-4332cb85d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:07.784464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbeb0-a1a9-434c-a6ff-4332cb85d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:07.804979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-47ecbeb0-a1a9-434c-a6ff-4332cb85d9d0 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:07.806101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-47ecbeb0-a1a9-434c-a6ff-4332cb85d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:07.815515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 939/1890] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:07.823802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4505fad-3964-4b94-b70c-2744b098a584 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:07.834452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4505fad-3964-4b94-b70c-2744b098a584 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:07.839754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:07.840411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:07.840694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:07.841019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:07.841733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:07.842043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:07.843764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:07.856910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 952/1891] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:06:07.862077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbeb0-a1a9-434c-a6ff-4332cb85d9d0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:07.872311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbeb0-a1a9-434c-a6ff-4332cb85d9d0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:07.877421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:07.878145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:07.878419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:07.878684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:07.879399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:07.881428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:07.912744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 940/1892] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:07 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:07.917172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:07.923986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:07.928083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88cafd-8348-4c47-9f69-9a83c6a4801d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:07.990748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:07.991408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:07.991674 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:07.991915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:07.992627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:07.994618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.017803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 953/1893] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:07 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:08.022318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.032922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a6876-3051-40e5-a35d-77f8fc44db40 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.037854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.038535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.038819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.039096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.039823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.041468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.052162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 941/1894] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:08.056278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.066420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0e2c9-69d3-4864-9a3a-04fd8d7702fe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.071259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38d9af-42ae-4526-80b3-b23cc46aae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.071911 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38d9af-42ae-4526-80b3-b23cc46aae2b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.072185 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38d9af-42ae-4526-80b3-b23cc46aae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.072455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38d9af-42ae-4526-80b3-b23cc46aae2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.073243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38d9af-42ae-4526-80b3-b23cc46aae2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.074838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38d9af-42ae-4526-80b3-b23cc46aae2b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.085009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 954/1895] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:08.089622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.100501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125c109-6646-4798-b9c1-3953bb338413 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.105534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.106450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.106725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.106994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] PATH_INFO: `/v3/projects/a3f20a9bee5845119eaa38527d2d63ec/users/88e930a0dff24c21b6333855d040c48e/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.121892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f20a9bee5845119eaa38527d2d63ec, user_id=88e930a0dff24c21b6333855d040c48e, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.124556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.141358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 942/1896] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:08 2022] PUT /identity/v3/projects/a3f20a9bee5845119eaa38527d2d63ec/users/88e930a0dff24c21b6333855d040c48e/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:08.152077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b8374-cefd-4c0a-8883-5323ba436307 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.152371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b8374-cefd-4c0a-8883-5323ba436307 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.152669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b8374-cefd-4c0a-8883-5323ba436307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.182076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-020b8374-cefd-4c0a-8883-5323ba436307 None None] MFA Rules not processed for user `88e930a0dff24c21b6333855d040c48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:08.183915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-020b8374-cefd-4c0a-8883-5323ba436307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:08.252894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 955/1897] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:08.257515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.322769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d782b-4346-4994-97b8-2ca089d6da7f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.329052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.329284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.329662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.329938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.330655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.332674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.360729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 943/1898] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:08 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:08.365046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b8374-cefd-4c0a-8883-5323ba436307 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.376171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b8374-cefd-4c0a-8883-5323ba436307 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.433380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.434044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.434321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.434588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.435314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.437274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.457408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 956/1899] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:08 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:08.461461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.471849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dadf79-fd45-462c-8a96-0ef5c51422eb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.476558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.477242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.477519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.477788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.478515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.480109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.490765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 944/1900] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:08.495142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.500374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:08.506097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2976e-fb59-4b0a-8a06-e22832f8c48b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.511437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.512339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.512672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.512947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] PATH_INFO: `/v3/projects/4f921702c84242e2873993b82868c364/users/368bc2620d2a45a48bcef5944a61414a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.528367 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f921702c84242e2873993b82868c364, user_id=368bc2620d2a45a48bcef5944a61414a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.531087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.546420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 957/1901] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:08 2022] PUT /identity/v3/projects/4f921702c84242e2873993b82868c364/users/368bc2620d2a45a48bcef5944a61414a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:08.551583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.561942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf12c8-0508-473d-a0f5-53f04f902643 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.624250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f7214-e804-4d7a-a8c9-254522b97a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.624969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f7214-e804-4d7a-a8c9-254522b97a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.625249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f7214-e804-4d7a-a8c9-254522b97a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.625518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f7214-e804-4d7a-a8c9-254522b97a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.626260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f7214-e804-4d7a-a8c9-254522b97a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.628085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f7214-e804-4d7a-a8c9-254522b97a87 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.640278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 945/1902] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:08.644382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.655274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbcc92-834f-4be4-9147-769741e94b73 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.660535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.661487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.661766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.662039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] PATH_INFO: `/v3/projects/4f921702c84242e2873993b82868c364/users/368bc2620d2a45a48bcef5944a61414a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.664052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f921702c84242e2873993b82868c364, user_id=368bc2620d2a45a48bcef5944a61414a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.666719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.678910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 958/1903] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:08 2022] PUT /identity/v3/projects/4f921702c84242e2873993b82868c364/users/368bc2620d2a45a48bcef5944a61414a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:08.690339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2b64-33be-482d-85e1-1a1ba8307d8c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.690656 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2b64-33be-482d-85e1-1a1ba8307d8c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.690932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2b64-33be-482d-85e1-1a1ba8307d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.697031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:08.719351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-96ba2b64-33be-482d-85e1-1a1ba8307d8c None None] MFA Rules not processed for user `368bc2620d2a45a48bcef5944a61414a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:08.720586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-96ba2b64-33be-482d-85e1-1a1ba8307d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:08.790928 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 946/1904] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:08.802621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.804571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:08.862214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feced18-921f-47c2-bba5-eb87bc90bdf9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.865853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.866525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.866801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.867064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:08.876371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:08.877898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:08.887098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 959/1905] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:08.977130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2b64-33be-482d-85e1-1a1ba8307d8c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:08.987065 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2b64-33be-482d-85e1-1a1ba8307d8c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:08.991363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543aff-c486-46a0-b5fa-7161aba4c454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:08.992008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543aff-c486-46a0-b5fa-7161aba4c454 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:08.992286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543aff-c486-46a0-b5fa-7161aba4c454 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:08.992557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543aff-c486-46a0-b5fa-7161aba4c454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:09.057823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543aff-c486-46a0-b5fa-7161aba4c454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:09.059298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543aff-c486-46a0-b5fa-7161aba4c454 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:09.069908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 947/1906] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:09.336285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:09.420487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c047a-4077-4653-8a25-776b712cb551 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:09.428262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:09.432096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:09.432096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:09.432096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] PATH_INFO: `/v3/users/88e930a0dff24c21b6333855d040c48e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:09.432096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e930a0dff24c21b6333855d040c48e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:09.433131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:09.487497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e930a0dff24c21b6333855d040c48e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:09.488221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e930a0dff24c21b6333855d040c48e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:09.498490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e930a0dff24c21b6333855d040c48e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:09.514294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:09.515690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e930a0dff24c21b6333855d040c48e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:09.525659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e930a0dff24c21b6333855d040c48e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:09.532152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 960/1907] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:09 2022] DELETE /identity/v3/users/88e930a0dff24c21b6333855d040c48e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:09.537039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:09.537309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:09.537610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:09.555351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:09.556576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:09.620305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 948/1908] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:09.630070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:09.631591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:09.694410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea34cd-11ca-4631-a036-3f2103f31e7c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:09.698893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:09.699682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:09.699682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:09.699682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:09.710940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:09.712866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:09.723246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 961/1909] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:10.091136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:10.092577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:10.104572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fdf91-ff17-472a-9dfe-285143ed4a08 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:10.109870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:10.111820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:10.111820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:10.111820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] PATH_INFO: `/v3/projects/a3f20a9bee5845119eaa38527d2d63ec` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:10.112619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f20a9bee5845119eaa38527d2d63ec)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:10.114561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:10.138228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:10.167127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f20a9bee5845119eaa38527d2d63ec', 'request_id': 'req-ee1685f1-adeb-419c-9d84-d375378fd185'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.173128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f20a9bee5845119eaa38527d2d63ec', 'request_id': 'req-ee1685f1-adeb-419c-9d84-d375378fd185'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.179435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f20a9bee5845119eaa38527d2d63ec', 'request_id': 'req-ee1685f1-adeb-419c-9d84-d375378fd185'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.194787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] The token cache is being invalidate because project a3f20a9bee5845119eaa38527d2d63ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:10.195072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.195710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.197290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 949/1910] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:10 2022] DELETE /identity/v3/projects/a3f20a9bee5845119eaa38527d2d63ec => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:10.201275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:10.210989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cfe2b-d9c3-487b-b50e-7e4a73b39d9f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:10.276973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:10.277864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:10.278147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:10.278432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] PATH_INFO: `/v3/users/368bc2620d2a45a48bcef5944a61414a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:10.279673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] RBAC: Authorizing `identity:delete_user(user_id=368bc2620d2a45a48bcef5944a61414a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:10.281753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:10.337420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368bc2620d2a45a48bcef5944a61414a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.338121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368bc2620d2a45a48bcef5944a61414a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.347403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368bc2620d2a45a48bcef5944a61414a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.359301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368bc2620d2a45a48bcef5944a61414a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.366360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3b4718c7-9372-4c14-b83c-4b497744964d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368bc2620d2a45a48bcef5944a61414a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.372758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 962/1911] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:10 2022] DELETE /identity/v3/users/368bc2620d2a45a48bcef5944a61414a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:10.659066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:10.660559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:10.681525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1685f1-adeb-419c-9d84-d375378fd185 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:10.760832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:10.761789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:10.762162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:10.762496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] PATH_INFO: `/v3/projects/4f921702c84242e2873993b82868c364` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:10.763843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f921702c84242e2873993b82868c364)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:10.766274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:10.814504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f921702c84242e2873993b82868c364', 'request_id': 'req-f3384b12-1941-4b8c-b777-4839c065bfaa'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.820091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f921702c84242e2873993b82868c364', 'request_id': 'req-f3384b12-1941-4b8c-b777-4839c065bfaa'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.826803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f921702c84242e2873993b82868c364', 'request_id': 'req-f3384b12-1941-4b8c-b777-4839c065bfaa'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.841180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] The token cache is being invalidate because project 4f921702c84242e2873993b82868c364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:10.841468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.842081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3384b12-1941-4b8c-b777-4839c065bfaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:10.843657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 950/1912] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:10 2022] DELETE /identity/v3/projects/4f921702c84242e2873993b82868c364 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:10.849803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9a971-dc41-41bc-8f8d-e10cecdad662 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:10.850090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9a971-dc41-41bc-8f8d-e10cecdad662 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:10.850361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9a971-dc41-41bc-8f8d-e10cecdad662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:10.869805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-abb9a971-dc41-41bc-8f8d-e10cecdad662 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:10.870960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-abb9a971-dc41-41bc-8f8d-e10cecdad662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:10.875414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:10.936150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 963/1913] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:10.944235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21e658-5dfc-452e-b063-34dc99958ea5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:10.944523 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21e658-5dfc-452e-b063-34dc99958ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:10.944832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21e658-5dfc-452e-b063-34dc99958ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:10.963864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eb21e658-5dfc-452e-b063-34dc99958ea5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:10.965123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eb21e658-5dfc-452e-b063-34dc99958ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:10.973501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 951/1914] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:10.978483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9a971-dc41-41bc-8f8d-e10cecdad662 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:10.991020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9a971-dc41-41bc-8f8d-e10cecdad662 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:10.997005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:10.997677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:10.997955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:10.998224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:10.998955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:10.999262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:11.000903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:11.013622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 964/1915] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:11.018142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21e658-5dfc-452e-b063-34dc99958ea5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:11.027743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21e658-5dfc-452e-b063-34dc99958ea5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:11.032412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:11.033092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:11.033370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:11.033637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:11.034412 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:11.036301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:11.063329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 952/1916] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:11 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:11.067556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:11.077596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0955f-b065-4ac5-bc0a-77244900d6f0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:11.135066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:11.135663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:11.136093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:11.136370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:11.137145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:11.139443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:11.165229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 965/1917] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:11 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:11.169613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:11.180222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565072d-a1cd-4e1a-b3b9-a7851d08bd26 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:11.185360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:11.186158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:11.186318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:11.186594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:11.187364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:11.188991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:11.195243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:11.201307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 953/1918] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:11.205164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:11.215651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae947d6-edd6-4d95-a87a-576d945b7151 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:11.220225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665ea19-38c7-4551-9665-0238a448b03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:11.220915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ea19-38c7-4551-9665-0238a448b03c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:11.221225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ea19-38c7-4551-9665-0238a448b03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:11.221530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ea19-38c7-4551-9665-0238a448b03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:11.222293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665ea19-38c7-4551-9665-0238a448b03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:11.223907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665ea19-38c7-4551-9665-0238a448b03c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:11.234116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 966/1919] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:11.238340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:11.248528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1889b-5b54-4f2f-b250-dc388b4e117c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:11.253260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:11.254150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:11.254427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:11.254697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] PATH_INFO: `/v3/projects/97d11f42edcf4654b1bd781c420ed4dd/users/b1bbe0b2fa0e47f896f6d26ac491be86/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:11.272250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d11f42edcf4654b1bd781c420ed4dd, user_id=b1bbe0b2fa0e47f896f6d26ac491be86, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:11.274959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:11.294793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 954/1920] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:11 2022] PUT /identity/v3/projects/97d11f42edcf4654b1bd781c420ed4dd/users/b1bbe0b2fa0e47f896f6d26ac491be86/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:11.308111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:11.308401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:11.308709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:11.335595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] MFA Rules not processed for user `b1bbe0b2fa0e47f896f6d26ac491be86`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:11.336888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:11.403602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 967/1921] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:11.415571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:11.417717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:11.474811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d0462-4f06-4599-bb16-3b072054e455 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:11.478589 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d92ab-1b2b-4da3-973f-4db2a374b2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:11.479239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d92ab-1b2b-4da3-973f-4db2a374b2aa service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:11.479518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d92ab-1b2b-4da3-973f-4db2a374b2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:11.479787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d92ab-1b2b-4da3-973f-4db2a374b2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:11.488305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d92ab-1b2b-4da3-973f-4db2a374b2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:11.489764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d92ab-1b2b-4da3-973f-4db2a374b2aa service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:11.498630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 955/1922] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:18.223999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:18.225467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:18.232859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:18.327871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b5130-ec86-4401-8e63-c1cb398d69f5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:18.336243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:18.340095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:18.340400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:18.341467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] PATH_INFO: `/v3/users/de45f7487f1d49cfa9c3b71af4eecf8f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:18.345355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de45f7487f1d49cfa9c3b71af4eecf8f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:18.350529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:18.448696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de45f7487f1d49cfa9c3b71af4eecf8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:18.451648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de45f7487f1d49cfa9c3b71af4eecf8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:18.465272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de45f7487f1d49cfa9c3b71af4eecf8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:18.514883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de45f7487f1d49cfa9c3b71af4eecf8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:18.550799 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de45f7487f1d49cfa9c3b71af4eecf8f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:18.577479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 968/1923] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:18 2022] DELETE /identity/v3/users/de45f7487f1d49cfa9c3b71af4eecf8f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:18.579540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:18.580026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:18.580126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:18.615507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:18.617390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:18.701669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 956/1924] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:18.724213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:18.725020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:18.811935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455051-5388-4df5-abc1-ec30d19d135c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:18.816093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ec052-7a32-4af7-b5b5-d423038551d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:18.819999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec052-7a32-4af7-b5b5-d423038551d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:18.820247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec052-7a32-4af7-b5b5-d423038551d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:18.820522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ec052-7a32-4af7-b5b5-d423038551d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:18.837229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ec052-7a32-4af7-b5b5-d423038551d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:18.838696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ec052-7a32-4af7-b5b5-d423038551d1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:18.850407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 969/1925] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:19.069666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:19.071352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:19.084156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd61914-00ed-4ecc-a652-827c14aed8e6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:19.090432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:19.091540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:19.092191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:19.092464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] PATH_INFO: `/v3/users/8c8b609d4a1f43fcb51a69a0c96984f5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:19.094267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8b609d4a1f43fcb51a69a0c96984f5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:19.097209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:19.165617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8b609d4a1f43fcb51a69a0c96984f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.166494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8b609d4a1f43fcb51a69a0c96984f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.167218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8b609d4a1f43fcb51a69a0c96984f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.179567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8b609d4a1f43fcb51a69a0c96984f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.196044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8b609d4a1f43fcb51a69a0c96984f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.217071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 957/1926] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:19 2022] DELETE /identity/v3/users/8c8b609d4a1f43fcb51a69a0c96984f5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:19.218357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:19.219589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:19.219589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:19.219896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:19.238887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:19.241676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:19.265878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:19.320769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 970/1927] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:19.323751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:19.325739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:19.330632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:19.333073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:19.344147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbfd1f-3ebc-433c-9cc6-b52f045ad8e5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:19.350351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:19.351251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:19.351529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:19.351802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] PATH_INFO: `/v3/projects/d2328dcf5fa1414aa9bcd8a8bfe9caef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:19.353018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2328dcf5fa1414aa9bcd8a8bfe9caef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:19.355471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:19.397269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766e83-2612-41bb-8a09-05d55112d60f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:19.406567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2328dcf5fa1414aa9bcd8a8bfe9caef', 'request_id': 'req-1313cca1-a4db-45b7-b519-a202a9ff655a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.412306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2328dcf5fa1414aa9bcd8a8bfe9caef', 'request_id': 'req-1313cca1-a4db-45b7-b519-a202a9ff655a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.418677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2328dcf5fa1414aa9bcd8a8bfe9caef', 'request_id': 'req-1313cca1-a4db-45b7-b519-a202a9ff655a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.432155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] The token cache is being invalidate because project d2328dcf5fa1414aa9bcd8a8bfe9caef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:19.432442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.433101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.434908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 958/1928] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:19 2022] DELETE /identity/v3/projects/d2328dcf5fa1414aa9bcd8a8bfe9caef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:19.438506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:19.439819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:19.445506 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:19.446168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:19.446452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:19.446723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:19.448485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:19.523960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313cca1-a4db-45b7-b519-a202a9ff655a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:19.528722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:19.529631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:19.529896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:19.530168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] PATH_INFO: `/v3/users/36773024e3474ceb98ee7683ada8c4d9` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:19.531352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36773024e3474ceb98ee7683ada8c4d9)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:19.533340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:19.538406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:19.539843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:19.549304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 971/1929] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:19.585606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36773024e3474ceb98ee7683ada8c4d9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.586305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36773024e3474ceb98ee7683ada8c4d9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.586953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36773024e3474ceb98ee7683ada8c4d9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.594992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36773024e3474ceb98ee7683ada8c4d9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.610024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36773024e3474ceb98ee7683ada8c4d9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:19.615906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:19.628939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 959/1930] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:19 2022] DELETE /identity/v3/users/36773024e3474ceb98ee7683ada8c4d9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:20.263095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.265969 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:20.282279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0d057-d09b-4f22-ab79-5d247ca6c497 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.293250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.296161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:20.321886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:20.352008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.352931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.353212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.353480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] PATH_INFO: `/v3/projects/d63d812572414784b282b79693df4d95` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.354749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63d812572414784b282b79693df4d95)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.356987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.365653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1caab91-fa0a-4a9d-bfc1-07ea921b16b7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.370239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.371113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.371395 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.371677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] PATH_INFO: `/v3/projects/8d6b4d3b2e434db29179643bc9fc5037` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.372896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6b4d3b2e434db29179643bc9fc5037)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.375092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.406172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63d812572414784b282b79693df4d95', 'request_id': 'req-2bfc4805-4e66-40e4-870e-20964661ff0c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.412049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63d812572414784b282b79693df4d95', 'request_id': 'req-2bfc4805-4e66-40e4-870e-20964661ff0c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.418181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63d812572414784b282b79693df4d95', 'request_id': 'req-2bfc4805-4e66-40e4-870e-20964661ff0c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.425351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6b4d3b2e434db29179643bc9fc5037', 'request_id': 'req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.431240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6b4d3b2e434db29179643bc9fc5037', 'request_id': 'req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.432271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] The token cache is being invalidate because project d63d812572414784b282b79693df4d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:20.432552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.433207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.434785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 972/1931] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:20 2022] DELETE /identity/v3/projects/d63d812572414784b282b79693df4d95 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:20.437585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6b4d3b2e434db29179643bc9fc5037', 'request_id': 'req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.438542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.439841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:20.452924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] The token cache is being invalidate because project 8d6b4d3b2e434db29179643bc9fc5037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:20.453228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.453837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9aeaed3c-7b4d-41dc-8f84-25bc24d78282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.455411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 960/1932] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:20 2022] DELETE /identity/v3/projects/8d6b4d3b2e434db29179643bc9fc5037 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:20.460364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b76a6-4189-411c-9d48-a3073220f3f7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.460659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b76a6-4189-411c-9d48-a3073220f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.461058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b76a6-4189-411c-9d48-a3073220f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.480250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fd3b76a6-4189-411c-9d48-a3073220f3f7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:20.481414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fd3b76a6-4189-411c-9d48-a3073220f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:20.505665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4805-4e66-40e4-870e-20964661ff0c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.542743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 961/1933] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:20.550297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f2fb-2bb7-44ba-91af-92b698df3b60 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.550586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f2fb-2bb7-44ba-91af-92b698df3b60 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.550859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1f2fb-2bb7-44ba-91af-92b698df3b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.567521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.568410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.568711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.568984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] PATH_INFO: `/v3/users/5ff1747d7280487caa0497116664afbe` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.569690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6dd1f2fb-2bb7-44ba-91af-92b698df3b60 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:20.570170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff1747d7280487caa0497116664afbe)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.570887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6dd1f2fb-2bb7-44ba-91af-92b698df3b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:20.572089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.578755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 962/1934] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:20.582991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1f2fb-2bb7-44ba-91af-92b698df3b60 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.585195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:20.592350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1f2fb-2bb7-44ba-91af-92b698df3b60 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.597388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.598211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.598496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.598793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.599614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:20.599920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.601669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.613921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 963/1935] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:06:20.618268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.620396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff1747d7280487caa0497116664afbe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.621079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff1747d7280487caa0497116664afbe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.624179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:20.628214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f26010-ec83-4ceb-8f92-70dea25e10ac admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.631404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff1747d7280487caa0497116664afbe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.635639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.636293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.636581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.636894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.637800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.640232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.644649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff1747d7280487caa0497116664afbe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.652168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff1747d7280487caa0497116664afbe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:20.659020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 973/1936] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:20 2022] DELETE /identity/v3/users/5ff1747d7280487caa0497116664afbe => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:20.676050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 964/1937] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:20 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:20.677487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.678944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:20.744194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076e72-2779-42be-a7a3-7dec0d074149 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.806176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.806876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.807154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.807422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.808134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.810147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.838615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 974/1938] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:20 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:20.839982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.851392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff033495-b21d-4ab6-a3b8-e7dd6529353c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.856613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.857613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.857896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.858169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.860383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.862094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.873951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 965/1939] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:20.877834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.889130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ab83f-e5be-407b-9b4f-412acc158243 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.900924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.901910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.902187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.902452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.903188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.904934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.918948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 975/1940] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:20.920516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.931470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b896-af23-4478-8bd1-71576654a4d7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.939055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d905f60-1326-40dd-957d-ff799b04b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:20.940147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905f60-1326-40dd-957d-ff799b04b3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:20.940380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905f60-1326-40dd-957d-ff799b04b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:20.940729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905f60-1326-40dd-957d-ff799b04b3b3 admin admin] PATH_INFO: `/v3/projects/799299393f6d4b10bd6a23f2e31ca7fe/users/c15b3065f1b94925a734e960de3bde4e/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:20.958876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d905f60-1326-40dd-957d-ff799b04b3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799299393f6d4b10bd6a23f2e31ca7fe, user_id=c15b3065f1b94925a734e960de3bde4e, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:20.961697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d905f60-1326-40dd-957d-ff799b04b3b3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:20.965909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:20.970040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:20.983781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b92cab-dd79-4b4b-845c-8cfa537b89a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:20.998450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:21.006201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 966/1941] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:20 2022] PUT /identity/v3/projects/799299393f6d4b10bd6a23f2e31ca7fe/users/c15b3065f1b94925a734e960de3bde4e/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:21.007856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.008133 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.008402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.039831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] MFA Rules not processed for user `c15b3065f1b94925a734e960de3bde4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:21.041100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:21.054072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.055199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.055612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.055974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] PATH_INFO: `/v3/projects/2b43df34963d4059b69032577161bd08` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.057203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b43df34963d4059b69032577161bd08)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.059143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.105304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 967/1942] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:21.106563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b43df34963d4059b69032577161bd08', 'request_id': 'req-fa49de36-b46e-475b-9956-330e7a7eee78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:21.111906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b43df34963d4059b69032577161bd08', 'request_id': 'req-fa49de36-b46e-475b-9956-330e7a7eee78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:21.116233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.117827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:21.118204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b43df34963d4059b69032577161bd08', 'request_id': 'req-fa49de36-b46e-475b-9956-330e7a7eee78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:21.133166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] The token cache is being invalidate because project 2b43df34963d4059b69032577161bd08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:21.133446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:21.134060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fa49de36-b46e-475b-9956-330e7a7eee78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:21.135612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 976/1943] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:20 2022] DELETE /identity/v3/projects/2b43df34963d4059b69032577161bd08 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:21.140677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650688f0-ac6a-42f8-90e5-a69ee0139345 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.140974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650688f0-ac6a-42f8-90e5-a69ee0139345 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.141233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650688f0-ac6a-42f8-90e5-a69ee0139345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.159962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-650688f0-ac6a-42f8-90e5-a69ee0139345 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:21.161282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-650688f0-ac6a-42f8-90e5-a69ee0139345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:21.183394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7e8e9-32c4-4588-acb7-9b735cf7eb7b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.227138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 977/1944] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:21.236247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062aa8d-3615-4638-9ea1-cefb6f817f2f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.237466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062aa8d-3615-4638-9ea1-cefb6f817f2f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.237466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062aa8d-3615-4638-9ea1-cefb6f817f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.258525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d062aa8d-3615-4638-9ea1-cefb6f817f2f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:21.259743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d062aa8d-3615-4638-9ea1-cefb6f817f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:21.265101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.265923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.266137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.266844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.268406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:21.277459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:21.288760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 978/1945] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:21.293752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062aa8d-3615-4638-9ea1-cefb6f817f2f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.304731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062aa8d-3615-4638-9ea1-cefb6f817f2f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.310644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.311895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.312226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.312511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.314158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:21.316837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.316837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.334181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 979/1946] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:21.341846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.362761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1546dd-83bd-47f7-b30b-e54b41cece4d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.367769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.368437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.368764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.369036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.370162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.371771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.372387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.373852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.383483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 968/1947] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:21.405729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 980/1948] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:21.410322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.421594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105927d7-0eee-41f6-a972-fe881c38f78e service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.477005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.477680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.477963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.478230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.478935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.480903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.502514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 969/1949] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:21.506962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.514450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:21.518484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c9d1-2b56-46ef-be4b-b270d08acb6f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.524975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.525680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.526090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.526195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.527118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.538639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.569905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 981/1950] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:21.570606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.591946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75b45b-8272-441a-986b-3e76ae615311 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.605216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6df67e-16e5-445d-9337-ebb8cb7a0222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.606011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6df67e-16e5-445d-9337-ebb8cb7a0222 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.606298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6df67e-16e5-445d-9337-ebb8cb7a0222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.606570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6df67e-16e5-445d-9337-ebb8cb7a0222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.607775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6df67e-16e5-445d-9337-ebb8cb7a0222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.611769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6df67e-16e5-445d-9337-ebb8cb7a0222 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.625806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 970/1951] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:21.630276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.643837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675fd63-515c-420b-aab0-ab0caca509cd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.650244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.651731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.652318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.652827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] PATH_INFO: `/v3/projects/2062e10a41f0460a990e3a09d2eb48d8/users/0b99d5084b8e449f95fc974cd515a1be/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.682193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2062e10a41f0460a990e3a09d2eb48d8, user_id=0b99d5084b8e449f95fc974cd515a1be, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.694792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.713825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 982/1952] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:21 2022] PUT /identity/v3/projects/2062e10a41f0460a990e3a09d2eb48d8/users/0b99d5084b8e449f95fc974cd515a1be/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:21.726154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063bf7-9dbe-4722-bbea-310f259a2964 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.726530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063bf7-9dbe-4722-bbea-310f259a2964 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.726802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063bf7-9dbe-4722-bbea-310f259a2964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.764844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-32063bf7-9dbe-4722-bbea-310f259a2964 None None] MFA Rules not processed for user `0b99d5084b8e449f95fc974cd515a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:21.766270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-32063bf7-9dbe-4722-bbea-310f259a2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:21.844711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 971/1953] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:21.849278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.913187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff3ad9-cb37-46b3-b67e-effbba322664 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.918936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:21.919601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:21.919877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:21.920145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:21.920880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:21.922821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:21.958773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 983/1954] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:21.962890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32063bf7-9dbe-4722-bbea-310f259a2964 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:21.973950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32063bf7-9dbe-4722-bbea-310f259a2964 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:21.985553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:22.032800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:22.033387 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:22.033663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:22.033932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:22.034620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:22.036561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:22.059089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 972/1955] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:21 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:22.063294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:22.073812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c0bb5-276e-4e88-8f21-c39418d609d4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:22.078479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:22.079142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:22.079416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:22.079682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:22.080408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:22.082077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:22.094392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 984/1956] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:22.098751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:22.109171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db107590-ab4a-4940-af2a-219f90241c17 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:22.114424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:22.115318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:22.115598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:22.115870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] PATH_INFO: `/v3/projects/9aeb1acfb4054983a63b7d53c17e62e5/users/3a44713d5035450fb7683df7b09d0e75/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:22.131073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeb1acfb4054983a63b7d53c17e62e5, user_id=3a44713d5035450fb7683df7b09d0e75, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:22.133881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:22.149200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 973/1957] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:22 2022] PUT /identity/v3/projects/9aeb1acfb4054983a63b7d53c17e62e5/users/3a44713d5035450fb7683df7b09d0e75/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:22.153279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:22.164461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe7705-a583-4f67-bb54-81beef22176e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:22.230595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee719-903b-46bd-9c8f-b8dba26844a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:22.231270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee719-903b-46bd-9c8f-b8dba26844a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:22.231548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee719-903b-46bd-9c8f-b8dba26844a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:22.231819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee719-903b-46bd-9c8f-b8dba26844a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:22.232548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ee719-903b-46bd-9c8f-b8dba26844a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:22.234200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ee719-903b-46bd-9c8f-b8dba26844a4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:22.244036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 985/1958] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:22.248954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:22.261539 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577cb9-35ab-40cf-adef-f56f27156ed8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:22.267547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:22.268493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:22.268811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:22.269085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] PATH_INFO: `/v3/projects/9aeb1acfb4054983a63b7d53c17e62e5/users/3a44713d5035450fb7683df7b09d0e75/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:22.271295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeb1acfb4054983a63b7d53c17e62e5, user_id=3a44713d5035450fb7683df7b09d0e75, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:22.273991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:22.284992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 974/1959] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:22 2022] PUT /identity/v3/projects/9aeb1acfb4054983a63b7d53c17e62e5/users/3a44713d5035450fb7683df7b09d0e75/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:22.295449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1eaec-858a-4638-89fd-2723b5575cb9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:22.295925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1eaec-858a-4638-89fd-2723b5575cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:22.296014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1eaec-858a-4638-89fd-2723b5575cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:22.325968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-62b1eaec-858a-4638-89fd-2723b5575cb9 None None] MFA Rules not processed for user `3a44713d5035450fb7683df7b09d0e75`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:22.327342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-62b1eaec-858a-4638-89fd-2723b5575cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:22.359945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:22.413395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 986/1960] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:22.425418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:22.427751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:22.522692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b852-29bd-45b8-adef-d9c56df36bee admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:22.527066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8deb0-0ba5-44f2-a735-7d2bd23bd712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:22.528335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8deb0-0ba5-44f2-a735-7d2bd23bd712 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:22.528739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8deb0-0ba5-44f2-a735-7d2bd23bd712 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:22.529149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8deb0-0ba5-44f2-a735-7d2bd23bd712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:22.541046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8deb0-0ba5-44f2-a735-7d2bd23bd712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:22.543210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8deb0-0ba5-44f2-a735-7d2bd23bd712 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:22.559082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 975/1961] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:23.354789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1eaec-858a-4638-89fd-2723b5575cb9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:23.448015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1eaec-858a-4638-89fd-2723b5575cb9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:23.452619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:23.453528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:23.453805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:23.454078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] PATH_INFO: `/v3/users/0b99d5084b8e449f95fc974cd515a1be` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:23.455335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b99d5084b8e449f95fc974cd515a1be)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:23.457666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:23.518878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b99d5084b8e449f95fc974cd515a1be'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:23.520680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b99d5084b8e449f95fc974cd515a1be'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:23.528563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b99d5084b8e449f95fc974cd515a1be'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:23.540843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b99d5084b8e449f95fc974cd515a1be'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:23.547866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b99d5084b8e449f95fc974cd515a1be'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:23.554449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 987/1962] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:23 2022] DELETE /identity/v3/users/0b99d5084b8e449f95fc974cd515a1be => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:23.559131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:23.559632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:23.559632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:23.579047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:23.580593 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:23.655306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 976/1963] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:23.668412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:23.673792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:23.739700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:23.755874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf711eb-0c34-49a1-9e49-6b8cb0dcacee admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:23.769197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:23.769897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:23.770179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:23.770549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:23.781975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:23.784062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:23.794666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 988/1964] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:24.125348 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:24.126770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:24.139579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81074-cb27-4b0d-9bf3-2ac11b348575 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:24.146858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:24.152067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:24.152337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:24.152707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] PATH_INFO: `/v3/projects/2062e10a41f0460a990e3a09d2eb48d8` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:24.154677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2062e10a41f0460a990e3a09d2eb48d8)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:24.157631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:24.167222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:24.220027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2062e10a41f0460a990e3a09d2eb48d8', 'request_id': 'req-2d369a13-89e6-4537-8f41-019cbe27e8bf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.225949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2062e10a41f0460a990e3a09d2eb48d8', 'request_id': 'req-2d369a13-89e6-4537-8f41-019cbe27e8bf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.233286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2062e10a41f0460a990e3a09d2eb48d8', 'request_id': 'req-2d369a13-89e6-4537-8f41-019cbe27e8bf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.251389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] The token cache is being invalidate because project 2062e10a41f0460a990e3a09d2eb48d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:24.251901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.252796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.254693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 977/1965] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:24 2022] DELETE /identity/v3/projects/2062e10a41f0460a990e3a09d2eb48d8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:24.258696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:24.274345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bad83-18b2-46cb-9dea-19e34c83b290 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:24.367893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:24.369932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:24.370340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:24.370706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] PATH_INFO: `/v3/users/3a44713d5035450fb7683df7b09d0e75` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:24.372193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a44713d5035450fb7683df7b09d0e75)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:24.374773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:24.442314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a44713d5035450fb7683df7b09d0e75'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.443216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a44713d5035450fb7683df7b09d0e75'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.454684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a44713d5035450fb7683df7b09d0e75'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.470580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a44713d5035450fb7683df7b09d0e75'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.480395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-742f3cdf-9499-4359-b3ee-e829cd017ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a44713d5035450fb7683df7b09d0e75'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.488088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 989/1966] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:24 2022] DELETE /identity/v3/users/3a44713d5035450fb7683df7b09d0e75 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:24.761535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:24.763894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:24.788124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d369a13-89e6-4537-8f41-019cbe27e8bf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:24.859913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:24.862048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:24.862394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:24.862801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] PATH_INFO: `/v3/users/c15b3065f1b94925a734e960de3bde4e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:24.864430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15b3065f1b94925a734e960de3bde4e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:24.866824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:24.963153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15b3065f1b94925a734e960de3bde4e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.964003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15b3065f1b94925a734e960de3bde4e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.965177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15b3065f1b94925a734e960de3bde4e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.979179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15b3065f1b94925a734e960de3bde4e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:24.999157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15b3065f1b94925a734e960de3bde4e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:25.013064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 978/1967] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:24 2022] DELETE /identity/v3/users/c15b3065f1b94925a734e960de3bde4e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:25.018028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:25.018336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:25.018558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:25.038671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:25.039910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:25.146088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 990/1968] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:25.192913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:25.195474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:25.225006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:25.319215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02beb-0ac7-4f52-b94a-ff981ee24aa8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:25.325457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade15b8-729c-43d6-a292-155dd2fc1a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:25.325457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade15b8-729c-43d6-a292-155dd2fc1a80 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:25.325457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade15b8-729c-43d6-a292-155dd2fc1a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:25.325457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade15b8-729c-43d6-a292-155dd2fc1a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:25.336247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade15b8-729c-43d6-a292-155dd2fc1a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:25.337900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade15b8-729c-43d6-a292-155dd2fc1a80 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:25.357736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 979/1969] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:25.550986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:25.553238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:25.567455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439956b-f373-45b7-b364-3203b1c7bb70 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:25.580421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:25.582269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:25.582798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:25.583276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] PATH_INFO: `/v3/projects/9aeb1acfb4054983a63b7d53c17e62e5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:25.584858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aeb1acfb4054983a63b7d53c17e62e5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:25.588419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:25.591403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:25.653948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aeb1acfb4054983a63b7d53c17e62e5', 'request_id': 'req-91b961a5-f5ff-4750-af69-2bb082bff451'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:25.662094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aeb1acfb4054983a63b7d53c17e62e5', 'request_id': 'req-91b961a5-f5ff-4750-af69-2bb082bff451'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:25.670464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aeb1acfb4054983a63b7d53c17e62e5', 'request_id': 'req-91b961a5-f5ff-4750-af69-2bb082bff451'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:25.686617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] The token cache is being invalidate because project 9aeb1acfb4054983a63b7d53c17e62e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:25.686760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:25.687384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-91b961a5-f5ff-4750-af69-2bb082bff451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:25.689182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 991/1970] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:25 2022] DELETE /identity/v3/projects/9aeb1acfb4054983a63b7d53c17e62e5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:25.696176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ac37-b79f-4c81-bb4f-6b9d8c8ae794 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:25.696578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ac37-b79f-4c81-bb4f-6b9d8c8ae794 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:25.697025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ac37-b79f-4c81-bb4f-6b9d8c8ae794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:25.715635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1610ac37-b79f-4c81-bb4f-6b9d8c8ae794 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:25.717999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1610ac37-b79f-4c81-bb4f-6b9d8c8ae794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:25.800216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 980/1971] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:25.808587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2731-6638-4b57-833f-456d801fe3d6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:25.808900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2731-6638-4b57-833f-456d801fe3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:25.809149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2731-6638-4b57-833f-456d801fe3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:25.844468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-67cc2731-6638-4b57-833f-456d801fe3d6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:25.846235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-67cc2731-6638-4b57-833f-456d801fe3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:25.866278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610ac37-b79f-4c81-bb4f-6b9d8c8ae794 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:25.875095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 992/1972] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:25.878407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610ac37-b79f-4c81-bb4f-6b9d8c8ae794 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:25.884466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:25.885514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:25.886024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:25.886452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:25.887193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:25.887505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:25.889509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:25.912480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 981/1973] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:25.914017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2731-6638-4b57-833f-456d801fe3d6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:25.931104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2731-6638-4b57-833f-456d801fe3d6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:25.940493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:25.942509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:25.943013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:25.943494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:25.944820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:25.948719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.000026 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 993/1974] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:25 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:26.002742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.021833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0ad72-3c6d-4fb4-80ff-dd9f52b74ce1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.100114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.102215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:26.122687 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.123416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.123701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.123971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.124715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.126739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.153634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 982/1975] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:26 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:26.157597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.170070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c594bf-250a-4916-8a9c-f09591765ae8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.177527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.178862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.179077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.179355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.180250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.181713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa35f6-3c72-466b-8c43-d2a7da7246f2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.181959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.186548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.187562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.187936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.188295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] PATH_INFO: `/v3/users/d365d3012ec6434296af2578e8bfbe52` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.189899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d365d3012ec6434296af2578e8bfbe52)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.192116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.193974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 983/1976] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:26.197647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.210554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0088e-7f40-45d0-8d5d-8f53d80487d6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.216607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.217405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.217754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.218094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.219024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.221491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.242505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 984/1977] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:26.256002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.265859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd365d3012ec6434296af2578e8bfbe52'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.265859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd365d3012ec6434296af2578e8bfbe52'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.275018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d86af-5d0d-487a-bc24-148b49cdaa23 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.282769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd365d3012ec6434296af2578e8bfbe52'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.296217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:26.297465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.300003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.300361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.300964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] PATH_INFO: `/v3/projects/0cb75de699ff4173ac43d7d53479cc10/users/688052c3d3c2488a8808c8066cf1765d/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.314942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd365d3012ec6434296af2578e8bfbe52'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.332949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-719ee9e2-3b41-4027-aa3f-27b5392959a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd365d3012ec6434296af2578e8bfbe52'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.342978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:26.343902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 994/1978] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:26 2022] DELETE /identity/v3/users/d365d3012ec6434296af2578e8bfbe52 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:26.358811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb75de699ff4173ac43d7d53479cc10, user_id=688052c3d3c2488a8808c8066cf1765d, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.363023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.381877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 985/1979] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:26 2022] PUT /identity/v3/projects/0cb75de699ff4173ac43d7d53479cc10/users/688052c3d3c2488a8808c8066cf1765d/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:26.393750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.394271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.394685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.445497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] MFA Rules not processed for user `688052c3d3c2488a8808c8066cf1765d`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:26.449561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:26.567194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 995/1980] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:26.571497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.573991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:26.729574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae12d-c3b4-4d1d-af95-40884acf98cc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.734598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.736367 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:26.738896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.739688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.739967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.740974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.742436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.745579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.761077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2695-47c4-496d-bdb3-3d8be134e66c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.783035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 986/1981] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:26 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:26.786861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.787822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.788179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.788473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] PATH_INFO: `/v3/projects/799299393f6d4b10bd6a23f2e31ca7fe` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.788813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.795667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=799299393f6d4b10bd6a23f2e31ca7fe)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.798366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.861028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799299393f6d4b10bd6a23f2e31ca7fe', 'request_id': 'req-e00471c7-05c5-44af-b546-bdcd1715b84f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.873521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799299393f6d4b10bd6a23f2e31ca7fe', 'request_id': 'req-e00471c7-05c5-44af-b546-bdcd1715b84f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.876837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137410a-4ab4-4a00-9024-d7c52808880d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:26.880042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799299393f6d4b10bd6a23f2e31ca7fe', 'request_id': 'req-e00471c7-05c5-44af-b546-bdcd1715b84f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.898217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] The token cache is being invalidate because project 799299393f6d4b10bd6a23f2e31ca7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:26.898405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.899012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e00471c7-05c5-44af-b546-bdcd1715b84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:26.900587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 996/1982] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:26 2022] DELETE /identity/v3/projects/799299393f6d4b10bd6a23f2e31ca7fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:26.905189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.905745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.906020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.925116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:26.926576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:26.959419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:26.960364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:26.960811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:26.961188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:26.962246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:26.964922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:26.987727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 987/1983] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:26 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:26.991864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:26.993304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:26.994011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.007728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a53d2-a012-4587-9972-05ea4eefca5b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.019721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 997/1984] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:27.019886 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e9768-a311-43e4-98da-19656f107021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.019886 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e9768-a311-43e4-98da-19656f107021 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.020070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.020145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e9768-a311-43e4-98da-19656f107021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.020145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e9768-a311-43e4-98da-19656f107021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.020145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e9768-a311-43e4-98da-19656f107021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.020323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.020405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e9768-a311-43e4-98da-19656f107021 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.020563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:27.031609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf31ed-76aa-494a-bf09-5e99fefe27de None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.035695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 988/1985] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:27.037146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87991b7-25da-4521-a9ba-e8a362b1f907 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.037441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87991b7-25da-4521-a9ba-e8a362b1f907 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.037722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87991b7-25da-4521-a9ba-e8a362b1f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.040464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.041604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.041890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.042162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] PATH_INFO: `/v3/projects/d80bc1bb98924a208eb2b5d0d1e6650a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.044242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80bc1bb98924a208eb2b5d0d1e6650a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.046405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.059339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d87991b7-25da-4521-a9ba-e8a362b1f907 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:27.060746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d87991b7-25da-4521-a9ba-e8a362b1f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.072700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 989/1986] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:27.072700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87991b7-25da-4521-a9ba-e8a362b1f907 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.083230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87991b7-25da-4521-a9ba-e8a362b1f907 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.091887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.092836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.093186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.093425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] PATH_INFO: `/v3/projects/cf3a7c91602c40088ba2a677e8009b0a/users/02df4d462faf4b53a6005d386b1e48d0/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.112596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3a7c91602c40088ba2a677e8009b0a, user_id=02df4d462faf4b53a6005d386b1e48d0, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.115946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80bc1bb98924a208eb2b5d0d1e6650a', 'request_id': 'req-7a64edb6-138b-48fe-92ff-50675e832a04'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.117640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.121833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80bc1bb98924a208eb2b5d0d1e6650a', 'request_id': 'req-7a64edb6-138b-48fe-92ff-50675e832a04'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.128672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80bc1bb98924a208eb2b5d0d1e6650a', 'request_id': 'req-7a64edb6-138b-48fe-92ff-50675e832a04'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.136982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 990/1987] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:27 2022] PUT /identity/v3/projects/cf3a7c91602c40088ba2a677e8009b0a/users/02df4d462faf4b53a6005d386b1e48d0/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:27.138010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.148118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] The token cache is being invalidate because project d80bc1bb98924a208eb2b5d0d1e6650a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:27.148538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.149222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.150857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 998/1988] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:27 2022] DELETE /identity/v3/projects/d80bc1bb98924a208eb2b5d0d1e6650a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:27.153822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.153822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.212511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cfe0d-1c2d-436f-8b98-4fd5b5155db1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.218192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.218324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.218678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.219020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.219829 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:27.220219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.221602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64edb6-138b-48fe-92ff-50675e832a04 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.222075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.226565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.227337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.228177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.228518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.229362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.231193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.240764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 991/1989] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:27.240764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.241019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.253802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 999/1990] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:27.254676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.256925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110ac7b-b882-4277-a16c-54eea68549b3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.258340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.262708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.264025 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.264381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.264767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] PATH_INFO: `/v3/users/f846d0150fda416aab08775461e16a5a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.266061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f846d0150fda416aab08775461e16a5a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.268330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.275588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03b2d0-3d15-425f-8ad5-cf6a15a1e2e6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.281071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.281813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.282248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.282590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.283442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.286706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.332823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1000/1991] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:27 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:27.334149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.359607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f846d0150fda416aab08775461e16a5a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.360442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f846d0150fda416aab08775461e16a5a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.361628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f846d0150fda416aab08775461e16a5a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.374167 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f846d0150fda416aab08775461e16a5a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.396816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:27.399422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f846d0150fda416aab08775461e16a5a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:27.412187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec2c6-2d6b-46d9-b32f-4e2d34153422 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.418585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231c89a-d364-4816-8147-4980cee4cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.419621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c89a-d364-4816-8147-4980cee4cda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.419789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c89a-d364-4816-8147-4980cee4cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.420291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231c89a-d364-4816-8147-4980cee4cda9 admin admin] PATH_INFO: `/v3/projects/cf3a7c91602c40088ba2a677e8009b0a/users/02df4d462faf4b53a6005d386b1e48d0/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.422753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231c89a-d364-4816-8147-4980cee4cda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3a7c91602c40088ba2a677e8009b0a, user_id=02df4d462faf4b53a6005d386b1e48d0, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.425523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231c89a-d364-4816-8147-4980cee4cda9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.426872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 992/1992] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:27 2022] DELETE /identity/v3/users/f846d0150fda416aab08775461e16a5a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:27.427922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.433528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.449153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1001/1993] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:27 2022] PUT /identity/v3/projects/cf3a7c91602c40088ba2a677e8009b0a/users/02df4d462faf4b53a6005d386b1e48d0/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:27.453858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26aedb-e6b8-44ab-93e5-12e8ad1c79af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.454261 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26aedb-e6b8-44ab-93e5-12e8ad1c79af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.454633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26aedb-e6b8-44ab-93e5-12e8ad1c79af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.478351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:27.511008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4f26aedb-e6b8-44ab-93e5-12e8ad1c79af None None] MFA Rules not processed for user `02df4d462faf4b53a6005d386b1e48d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:27.512423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4f26aedb-e6b8-44ab-93e5-12e8ad1c79af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.520697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deddb5-8ebc-403d-9b3e-df2b85d320d9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.618990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.620186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.623198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.623763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.624626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.627907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.667341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1002/1994] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:27.679369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 993/1995] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:27 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:27.680263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26aedb-e6b8-44ab-93e5-12e8ad1c79af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.692362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.698480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.714904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26aedb-e6b8-44ab-93e5-12e8ad1c79af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.726336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.727140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.727424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.728127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.728894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.732978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.756787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1003/1996] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:27.762015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.785126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbeb8b-1419-404f-b473-09fe8efaf501 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.787315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249513-78a5-4f7e-bc17-68f71641512e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.792103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.793134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.793566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.793987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.794924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.796821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.803865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.805204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.805487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.806076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.834669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.836249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.840719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1004/1997] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:27.841727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.848845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:27.860254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 994/1998] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:27.861963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:27.875034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506214-8fee-46c7-90d2-a78cfb13f96e service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.880045 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5028b2e-956d-45c1-b06c-95d58a914a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.881202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028b2e-956d-45c1-b06c-95d58a914a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.881906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028b2e-956d-45c1-b06c-95d58a914a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.881906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5028b2e-956d-45c1-b06c-95d58a914a22 admin admin] PATH_INFO: `/v3/projects/6bc69ff322e44b6bbb16f61a74cbf806/users/2628840465524400a68b1e1f2a41b048/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.888340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fbc01-531a-414c-91d3-10387803b7f2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:27.894891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:27.896259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.896259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.896492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] PATH_INFO: `/v3/projects/474c5873ab4045d99970d6526dcf4c3a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:27.904340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5028b2e-956d-45c1-b06c-95d58a914a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc69ff322e44b6bbb16f61a74cbf806, user_id=2628840465524400a68b1e1f2a41b048, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.907892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5028b2e-956d-45c1-b06c-95d58a914a22 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.909153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=474c5873ab4045d99970d6526dcf4c3a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:27.911157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:27.939703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 995/1999] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:27 2022] PUT /identity/v3/projects/6bc69ff322e44b6bbb16f61a74cbf806/users/2628840465524400a68b1e1f2a41b048/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:27.950200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:27.950700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:27.951409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.003492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474c5873ab4045d99970d6526dcf4c3a', 'request_id': 'req-c04a8217-1ae1-4455-9c4d-57a213adb33c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:28.020215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] MFA Rules not processed for user `2628840465524400a68b1e1f2a41b048`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:28.022086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.034990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474c5873ab4045d99970d6526dcf4c3a', 'request_id': 'req-c04a8217-1ae1-4455-9c4d-57a213adb33c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:28.051675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474c5873ab4045d99970d6526dcf4c3a', 'request_id': 'req-c04a8217-1ae1-4455-9c4d-57a213adb33c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:28.075449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:28.082666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] The token cache is being invalidate because project 474c5873ab4045d99970d6526dcf4c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:28.083042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:28.084518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c04a8217-1ae1-4455-9c4d-57a213adb33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:28.086063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1005/2000] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:27 2022] DELETE /identity/v3/projects/474c5873ab4045d99970d6526dcf4c3a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:28.091188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de29af-9d45-4b98-8ad9-14426ca72088 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.091475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de29af-9d45-4b98-8ad9-14426ca72088 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.091798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de29af-9d45-4b98-8ad9-14426ca72088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.113848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d0de29af-9d45-4b98-8ad9-14426ca72088 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:28.115085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d0de29af-9d45-4b98-8ad9-14426ca72088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.121006 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 996/2001] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:28.122979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.130077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.174544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:28.223894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1006/2002] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:28.234946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2cf80-bdce-49c9-8633-f04bcf58ff99 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.236205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2cf80-bdce-49c9-8633-f04bcf58ff99 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.236655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2cf80-bdce-49c9-8633-f04bcf58ff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.269213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fca2cf80-bdce-49c9-8633-f04bcf58ff99 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:28.270529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fca2cf80-bdce-49c9-8633-f04bcf58ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.279260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1007/2003] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:28.283228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2cf80-bdce-49c9-8633-f04bcf58ff99 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.293811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2cf80-bdce-49c9-8633-f04bcf58ff99 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.297689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfd96f-1b3f-42f4-975d-85b914881e99 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.301529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.302322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.302609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.302879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.303625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:28.303936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.305525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.305880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.306525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.306941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.307370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.308206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.310312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.318868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1008/2004] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:06:28.323329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.335342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f6e1-21e4-4e12-98a7-8f546a81896f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.339925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.340597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.340926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.341202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.341905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.343887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.356546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 997/2005] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:28.360781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.386426 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1009/2006] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:28.387418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.453901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07b34-060f-4d94-a7e9-47ea4b703f69 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.476708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9801a4-d957-4d90-af20-17fc3013e14f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.487740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.488900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.489395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.489672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.490445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.492979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.536570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1010/2007] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:28.536570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.550978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a31045-92bb-46ed-afa8-2383a01f61eb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.558313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.559432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.559716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.559977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.560914 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.562355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.563219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.563706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.564080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.564986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.565120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.568324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.580599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1011/2008] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:28.584283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.585099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:28.597651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 998/2009] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:28.598326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b664be1-863e-48d8-8273-7991d1528afe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.600592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.608822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.609570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.609840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.611602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.612355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.612481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b3ac-b8ff-4d0c-bb7d-a1c44213d10d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.614371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.625344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.626455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.626992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.627186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1012/2010] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:28.627606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.628547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.630666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.631424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.646647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30c44a-9f63-4b23-830d-69bcbf96a0ce admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.653046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 999/2011] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:28.654384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71762b8-dfe4-466b-b32f-e26f3dbc63d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.655177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71762b8-dfe4-466b-b32f-e26f3dbc63d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.655464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71762b8-dfe4-466b-b32f-e26f3dbc63d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.655826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71762b8-dfe4-466b-b32f-e26f3dbc63d1 admin admin] PATH_INFO: `/v3/projects/ec6701de15d94b59b4daaf1cd2dcd490/users/36bcc21f01ff40af90d48931418a7afe/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.657249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.668889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc01c4-1b61-4bc3-89c5-1323d3eff7df admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.674809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.675489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.675896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.676382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.677932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.678594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.682732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71762b8-dfe4-466b-b32f-e26f3dbc63d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6701de15d94b59b4daaf1cd2dcd490, user_id=36bcc21f01ff40af90d48931418a7afe, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.686847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71762b8-dfe4-466b-b32f-e26f3dbc63d1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.700817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1000/2012] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:28.701749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.712111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1013/2013] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:28 2022] PUT /identity/v3/projects/ec6701de15d94b59b4daaf1cd2dcd490/users/36bcc21f01ff40af90d48931418a7afe/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:28.713557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1caa99-454b-44a7-9d45-0893047d46c9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.725788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b108-584c-47a8-9b77-e6761248ad8d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.726605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b108-584c-47a8-9b77-e6761248ad8d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.727159 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b108-584c-47a8-9b77-e6761248ad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.763515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7782b108-584c-47a8-9b77-e6761248ad8d None None] MFA Rules not processed for user `36bcc21f01ff40af90d48931418a7afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:28.764806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7782b108-584c-47a8-9b77-e6761248ad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.790829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:28.797136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.798275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.798950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.798950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] PATH_INFO: `/v3/projects/7eaf89c54ab44e6ea7cac70cca160be9/users/4f53e1d8ab504461be1b12aa71df4789/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.815328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eaf89c54ab44e6ea7cac70cca160be9, user_id=4f53e1d8ab504461be1b12aa71df4789, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.818119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.844667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1001/2014] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:28 2022] PUT /identity/v3/projects/7eaf89c54ab44e6ea7cac70cca160be9/users/4f53e1d8ab504461be1b12aa71df4789/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:28.844667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.844667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.875214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1014/2015] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:28.875214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.875214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.875214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.912509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] MFA Rules not processed for user `4f53e1d8ab504461be1b12aa71df4789`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:28.913855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.915356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded348f-e191-4ccf-844d-9e839a9f6448 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:28.920562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:28.921622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:28.921831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:28.922105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] PATH_INFO: `/v3/users/688052c3d3c2488a8808c8066cf1765d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:28.923371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=688052c3d3c2488a8808c8066cf1765d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:28.925464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:28.988509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1015/2016] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:28.989413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:28.990714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:28.993185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688052c3d3c2488a8808c8066cf1765d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:28.994016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688052c3d3c2488a8808c8066cf1765d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:28.994844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688052c3d3c2488a8808c8066cf1765d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.004715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688052c3d3c2488a8808c8066cf1765d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.014779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:29.022702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688052c3d3c2488a8808c8066cf1765d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.049919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1002/2017] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:28 2022] DELETE /identity/v3/users/688052c3d3c2488a8808c8066cf1765d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:29.050723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.052109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.074774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79de63-ae39-4d99-899b-cbc2b5f0e9d5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.132968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276102-b6b2-42b6-b821-e11548bfa6ed admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.141968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150445d1-787b-4822-995c-85bb6445a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.142954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150445d1-787b-4822-995c-85bb6445a102 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.143381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150445d1-787b-4822-995c-85bb6445a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.144736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.145298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150445d1-787b-4822-995c-85bb6445a102 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.145687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.146037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.146372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.146927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150445d1-787b-4822-995c-85bb6445a102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.149109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.152949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150445d1-787b-4822-995c-85bb6445a102 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.174369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:29.198115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1003/2018] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:29 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:29.203340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.203708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.204109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.228770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:29.230183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.232568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.234181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.246191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1016/2019] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:29.247092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.258259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a1fd-0a90-42f4-bdc7-b4d19aa9aec3 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.324528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1004/2020] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:29.325628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.327098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.340247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.341229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.341519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.342276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.343006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.345006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.356213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317f06e-d2dd-4043-9156-bbd5ac7ed1c1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.361614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.362555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.362927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.363257 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] PATH_INFO: `/v3/users/36bcc21f01ff40af90d48931418a7afe` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.364664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36bcc21f01ff40af90d48931418a7afe)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.366951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.377593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1017/2021] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:29 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:29.377593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.378934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.431041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36bcc21f01ff40af90d48931418a7afe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.431721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36bcc21f01ff40af90d48931418a7afe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.432511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36bcc21f01ff40af90d48931418a7afe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.442037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36bcc21f01ff40af90d48931418a7afe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.448559 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818163-6695-489b-852e-30611df732d0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.448929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:29.452796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d98b-03a1-4ef8-b4d9-ae12e760fbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.453462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d98b-03a1-4ef8-b4d9-ae12e760fbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.453746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d98b-03a1-4ef8-b4d9-ae12e760fbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.454023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d98b-03a1-4ef8-b4d9-ae12e760fbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.457689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5eb6d98b-03a1-4ef8-b4d9-ae12e760fbe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.458905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36bcc21f01ff40af90d48931418a7afe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.473319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d98b-03a1-4ef8-b4d9-ae12e760fbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.474954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d98b-03a1-4ef8-b4d9-ae12e760fbe9 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.477264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1005/2022] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:29 2022] DELETE /identity/v3/users/36bcc21f01ff40af90d48931418a7afe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:29.477916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.479255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.488495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1018/2023] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:29.490149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91245-70cf-4f17-bf68-28ccfec6e650 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.490149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91245-70cf-4f17-bf68-28ccfec6e650 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.490410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f91245-70cf-4f17-bf68-28ccfec6e650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.510128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a1f91245-70cf-4f17-bf68-28ccfec6e650 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:29.511598 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a1f91245-70cf-4f17-bf68-28ccfec6e650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.561479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe45ea-8660-4e5f-b7be-846116dd56f3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.566373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:29.568136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.568998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.569430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.569789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.570661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.572376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.583143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1019/2024] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:29.587075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1006/2025] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:29.594277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f91245-70cf-4f17-bf68-28ccfec6e650 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.594494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.596570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.604434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f91245-70cf-4f17-bf68-28ccfec6e650 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.609987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.610966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.611346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.611695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] PATH_INFO: `/v3/projects/874624a18e7c4796a7304db67c8bcd37/users/9f548f28075548459a135dbaa27c2057/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.627934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] RBAC: Authorizing `identity:create_grant(project_id=874624a18e7c4796a7304db67c8bcd37, user_id=9f548f28075548459a135dbaa27c2057, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.630708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.650004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1020/2026] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:29 2022] PUT /identity/v3/projects/874624a18e7c4796a7304db67c8bcd37/users/9f548f28075548459a135dbaa27c2057/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:29.654413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.680022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d7ec6-ff5d-4ceb-8274-46718c1868c6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.726717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4307-7471-4720-be43-65fe6b06524a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.732126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.732868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.733151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.733427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.734160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.735913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.738204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.738861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.739143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.739413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.748815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1021/2027] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:29.750030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.750680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.751669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.763733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1007/2028] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:29.767540 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6afcaf-7bd8-44f6-8be8-ac3bb250828a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.772453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661e06-90b3-49b3-8ae6-9b4d497aed2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.773582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e06-90b3-49b3-8ae6-9b4d497aed2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.773890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e06-90b3-49b3-8ae6-9b4d497aed2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.774172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e06-90b3-49b3-8ae6-9b4d497aed2b admin admin] PATH_INFO: `/v3/projects/874624a18e7c4796a7304db67c8bcd37/users/9f548f28075548459a135dbaa27c2057/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.776252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661e06-90b3-49b3-8ae6-9b4d497aed2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=874624a18e7c4796a7304db67c8bcd37, user_id=9f548f28075548459a135dbaa27c2057, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.778993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661e06-90b3-49b3-8ae6-9b4d497aed2b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.791413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1022/2029] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:29 2022] PUT /identity/v3/projects/874624a18e7c4796a7304db67c8bcd37/users/9f548f28075548459a135dbaa27c2057/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:29.800433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.800433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.802589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.803025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.803378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.815170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcc3c2-4287-41db-a8a6-3a88189c470f service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:29.848221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] MFA Rules not processed for user `9f548f28075548459a135dbaa27c2057`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:29.849974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.857708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:29.904341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:29.905263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:29.905543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:29.905817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] PATH_INFO: `/v3/projects/0cb75de699ff4173ac43d7d53479cc10` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:29.907104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb75de699ff4173ac43d7d53479cc10)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:29.909181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:29.954706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1023/2030] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:29.965784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:29.967452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:29.970545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb75de699ff4173ac43d7d53479cc10', 'request_id': 'req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.977837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb75de699ff4173ac43d7d53479cc10', 'request_id': 'req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:29.985939 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb75de699ff4173ac43d7d53479cc10', 'request_id': 'req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.002625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] The token cache is being invalidate because project 0cb75de699ff4173ac43d7d53479cc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:30.003409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.003748 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.006014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1008/2031] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:29 2022] DELETE /identity/v3/projects/0cb75de699ff4173ac43d7d53479cc10 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:30.009915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.011610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:30.017803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:30.037119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131639fd-b317-409e-8708-c8e9f1832a3e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.083173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7667d-affc-4f26-8d26-c5a44dbb30cc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.088856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.089982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.090793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.091269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] PATH_INFO: `/v3/users/02df4d462faf4b53a6005d386b1e48d0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.092730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=02df4d462faf4b53a6005d386b1e48d0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.094836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.097915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.098726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.100800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.101111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.103131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:30.165571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02df4d462faf4b53a6005d386b1e48d0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.166846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02df4d462faf4b53a6005d386b1e48d0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.167641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02df4d462faf4b53a6005d386b1e48d0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.177106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.178504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02df4d462faf4b53a6005d386b1e48d0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.178661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.186598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:30.188133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1024/2032] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:30.189177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.190758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:30.201628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0e77b31-57ae-4cbe-b27b-477d6b9a64fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02df4d462faf4b53a6005d386b1e48d0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.204792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2484ed-3372-4ba9-abfd-ed23797f72c5 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.209710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.210773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.211053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.211320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] PATH_INFO: `/v3/projects/ec6701de15d94b59b4daaf1cd2dcd490` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.212477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6701de15d94b59b4daaf1cd2dcd490)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.214420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.217974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1009/2033] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:30 2022] DELETE /identity/v3/users/02df4d462faf4b53a6005d386b1e48d0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:30.273151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6701de15d94b59b4daaf1cd2dcd490', 'request_id': 'req-7ea066a5-a5bb-403f-8af8-e53240dd371c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.280372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6701de15d94b59b4daaf1cd2dcd490', 'request_id': 'req-7ea066a5-a5bb-403f-8af8-e53240dd371c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.289899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6701de15d94b59b4daaf1cd2dcd490', 'request_id': 'req-7ea066a5-a5bb-403f-8af8-e53240dd371c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.308473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] The token cache is being invalidate because project ec6701de15d94b59b4daaf1cd2dcd490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:30.309123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.310391 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7ea066a5-a5bb-403f-8af8-e53240dd371c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.317003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1025/2034] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:30 2022] DELETE /identity/v3/projects/ec6701de15d94b59b4daaf1cd2dcd490 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:30.318786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f788-4cca-47eb-9680-aec8dd51f8e7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.319246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f788-4cca-47eb-9680-aec8dd51f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.319379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f788-4cca-47eb-9680-aec8dd51f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.352051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2b96f788-4cca-47eb-9680-aec8dd51f8e7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:30.353595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2b96f788-4cca-47eb-9680-aec8dd51f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:30.473977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1010/2035] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:30.481695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969148f5-f7eb-4482-b4ef-af515730f23c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.481886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969148f5-f7eb-4482-b4ef-af515730f23c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.482307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969148f5-f7eb-4482-b4ef-af515730f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.512099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-969148f5-f7eb-4482-b4ef-af515730f23c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:30.513711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-969148f5-f7eb-4482-b4ef-af515730f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:30.524702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1026/2036] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:30.529155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96f788-4cca-47eb-9680-aec8dd51f8e7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.539899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96f788-4cca-47eb-9680-aec8dd51f8e7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.545761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.546360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.546639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.546956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.547916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:30.548355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.550117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.584430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1011/2037] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:30.586837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969148f5-f7eb-4482-b4ef-af515730f23c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.602200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969148f5-f7eb-4482-b4ef-af515730f23c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.615511 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.616213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.616492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.616792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.617492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.619777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.664079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1027/2038] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:30 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:30.670231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.697763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9891-1853-4add-97a5-b6672b4b3744 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.708892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.711315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:30.718190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:30.771441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.772119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.772450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.772756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.773465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.775530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.801459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1012/2039] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:30 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:30.801673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5ae26-ce5f-4b76-ba5b-c9d1148e98d0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.803222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.803628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.804667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.804973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.805247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] PATH_INFO: `/v3/projects/cf3a7c91602c40088ba2a677e8009b0a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.806516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3a7c91602c40088ba2a677e8009b0a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.808507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.813155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97899e1-7922-4592-8366-c6e71a5cd65d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.818003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.818659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.818932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.819200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.819935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.821559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.831638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1013/2040] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:30.835995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.845975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa7c3-12d9-4013-a9db-048f409f3551 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.850583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.851264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.851543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.851812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.852530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.854174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.863512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3a7c91602c40088ba2a677e8009b0a', 'request_id': 'req-abbf20be-7e3a-429e-a84c-1e295e036ba6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.865763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1014/2041] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:30.870497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:30.870845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3a7c91602c40088ba2a677e8009b0a', 'request_id': 'req-abbf20be-7e3a-429e-a84c-1e295e036ba6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.878666 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3a7c91602c40088ba2a677e8009b0a', 'request_id': 'req-abbf20be-7e3a-429e-a84c-1e295e036ba6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.880496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd27435-bfa1-4b75-be8a-3231c003c53a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:30.894987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] The token cache is being invalidate because project cf3a7c91602c40088ba2a677e8009b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:30.895440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.896211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abbf20be-7e3a-429e-a84c-1e295e036ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:30.898006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1028/2042] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:30 2022] DELETE /identity/v3/projects/cf3a7c91602c40088ba2a677e8009b0a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:30.906605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef7c0-a1f6-4517-ba53-c64fa8084d69 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.907036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef7c0-a1f6-4517-ba53-c64fa8084d69 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.907314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef7c0-a1f6-4517-ba53-c64fa8084d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.917627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:30.929930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-011ef7c0-a1f6-4517-ba53-c64fa8084d69 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:30.931304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-011ef7c0-a1f6-4517-ba53-c64fa8084d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:30.947474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab24d6c-f94f-48a3-83db-5d5cf206c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:30.948385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24d6c-f94f-48a3-83db-5d5cf206c18a admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.948688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24d6c-f94f-48a3-83db-5d5cf206c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.948965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24d6c-f94f-48a3-83db-5d5cf206c18a admin admin] PATH_INFO: `/v3/projects/bd85d603f73f418b84874c1d0a3f44c3/users/7dbe87f393c441e3858148818b7cf6b9/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:30.964947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab24d6c-f94f-48a3-83db-5d5cf206c18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd85d603f73f418b84874c1d0a3f44c3, user_id=7dbe87f393c441e3858148818b7cf6b9, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:30.967615 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab24d6c-f94f-48a3-83db-5d5cf206c18a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:30.983404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1015/2043] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:30 2022] PUT /identity/v3/projects/bd85d603f73f418b84874c1d0a3f44c3/users/7dbe87f393c441e3858148818b7cf6b9/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:30.994470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:30.994675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:30.994946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.000538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1029/2044] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:31.008278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f312a67-b47f-47f5-99d8-f2e404c65b0c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.009210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f312a67-b47f-47f5-99d8-f2e404c65b0c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.009723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f312a67-b47f-47f5-99d8-f2e404c65b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.030516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] MFA Rules not processed for user `7dbe87f393c441e3858148818b7cf6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:31.031750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:31.034411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0f312a67-b47f-47f5-99d8-f2e404c65b0c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:31.035944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0f312a67-b47f-47f5-99d8-f2e404c65b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:31.068822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:31.104265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1030/2045] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:31.108834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f312a67-b47f-47f5-99d8-f2e404c65b0c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.109256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1016/2046] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:31.119956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f312a67-b47f-47f5-99d8-f2e404c65b0c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.120414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.121857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:31.125232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.125986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.126333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.126670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.127599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:31.128078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.130123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.147299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1031/2047] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:06:31.151660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.163764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b4abf-c1dc-4a2b-b043-566144d39ee7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.169739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.170468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.170755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.171071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.171789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.173782 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.195363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a7669-1ace-47f3-aded-6d37a2076c86 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.199050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.199688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.199972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.200228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.208761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1032/2048] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:31 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:31.211300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.213618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.215988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.228393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1017/2049] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:31.290254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270787c4-7ca2-461c-840e-b698489beaf8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.295867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.296814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.297237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.297555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.298319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.300277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.326634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1033/2050] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:31 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:31.332606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.345332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90df07-0474-4733-85ed-cdba0e746708 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.350884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.351380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.351653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.351973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.352604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.354250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.365557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1018/2051] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:31.369930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.380975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfce62-335b-4fc3-8609-9d6069b95921 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.389146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b427b-7009-46ed-b608-e3ca4fd7b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.390125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b427b-7009-46ed-b608-e3ca4fd7b7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.390428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b427b-7009-46ed-b608-e3ca4fd7b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.390708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b427b-7009-46ed-b608-e3ca4fd7b7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.393481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b427b-7009-46ed-b608-e3ca4fd7b7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.395623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b427b-7009-46ed-b608-e3ca4fd7b7a5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.409292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1034/2052] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:31.413812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.424490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b288a-9d62-4fd4-8349-cf4e8c768548 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.432575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.433592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.433948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.434310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] PATH_INFO: `/v3/projects/899fdc60018b4f8484dc4665ca737c9d/users/99229b4c83a34782a4ba080be30b1cfa/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.449888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899fdc60018b4f8484dc4665ca737c9d, user_id=99229b4c83a34782a4ba080be30b1cfa, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.452546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.472143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1019/2053] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:31 2022] PUT /identity/v3/projects/899fdc60018b4f8484dc4665ca737c9d/users/99229b4c83a34782a4ba080be30b1cfa/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:31.483645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f11cb-f0c8-48fa-ba93-776acd890cb7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.485099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f11cb-f0c8-48fa-ba93-776acd890cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.485387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f11cb-f0c8-48fa-ba93-776acd890cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.539396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-282f11cb-f0c8-48fa-ba93-776acd890cb7 None None] MFA Rules not processed for user `99229b4c83a34782a4ba080be30b1cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:31.541436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-282f11cb-f0c8-48fa-ba93-776acd890cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:31.631041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1035/2054] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:31.635380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.664226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:31.725117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31adcf-08c5-42a1-be68-bfa419aeb7f3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.730837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.731558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.731891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.732213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.733361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.737775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.767265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1020/2055] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:31 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:31.771266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f11cb-f0c8-48fa-ba93-776acd890cb7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.782767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f11cb-f0c8-48fa-ba93-776acd890cb7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.788519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:31.872054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.872774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.873060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.873335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.874045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.876121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.895602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.897685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:31.900688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1036/2056] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:31 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:31.903734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.913570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420a30-267b-4b00-8acc-c27997dd074e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.918564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.919223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.919495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.919761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.920490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.922274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.932788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1037/2057] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:31.936759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:31.948439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65573f8b-62a0-426b-8be7-088b04909a4e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.953035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.953927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.954198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.954581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] PATH_INFO: `/v3/projects/64ca7d0f315e4c4d8c249283058f3993/users/8c660c10f44249e8a538c30e467fe79d/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.956831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471ecae-f278-4fbe-bf7b-19a656bcc487 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:31.960664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:31.961321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:31.961597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:31.961866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:31.963634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:31.969131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ca7d0f315e4c4d8c249283058f3993, user_id=8c660c10f44249e8a538c30e467fe79d, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:31.971809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:31.986309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1038/2058] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:31 2022] PUT /identity/v3/projects/64ca7d0f315e4c4d8c249283058f3993/users/8c660c10f44249e8a538c30e467fe79d/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:31.990156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:32.028223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:32.029620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:32.039261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1021/2059] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:32.052578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc148-fb83-4487-be50-a639e7a955bd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:32.057422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d151967-0ce1-4db4-85af-4234981f96d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:32.058086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151967-0ce1-4db4-85af-4234981f96d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:32.058402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151967-0ce1-4db4-85af-4234981f96d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:32.058673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151967-0ce1-4db4-85af-4234981f96d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:32.059400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d151967-0ce1-4db4-85af-4234981f96d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:32.061016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d151967-0ce1-4db4-85af-4234981f96d9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:32.074383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1039/2060] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:32.075677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:32.086731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f16b-85a7-4a96-a2ff-9465296b24ec service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:32.100019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:32.100977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:32.102232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:32.102232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] PATH_INFO: `/v3/projects/64ca7d0f315e4c4d8c249283058f3993/users/8c660c10f44249e8a538c30e467fe79d/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:32.103901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ca7d0f315e4c4d8c249283058f3993, user_id=8c660c10f44249e8a538c30e467fe79d, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:32.106707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:32.118820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1022/2061] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:32 2022] PUT /identity/v3/projects/64ca7d0f315e4c4d8c249283058f3993/users/8c660c10f44249e8a538c30e467fe79d/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:32.128570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28ed8-91be-4661-b695-d4f35d9c2bb2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:32.128883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28ed8-91be-4661-b695-d4f35d9c2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:32.129160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28ed8-91be-4661-b695-d4f35d9c2bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:32.158464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d0f28ed8-91be-4661-b695-d4f35d9c2bb2 None None] MFA Rules not processed for user `8c660c10f44249e8a538c30e467fe79d`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:32.159780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d0f28ed8-91be-4661-b695-d4f35d9c2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:32.209549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:32.233794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1040/2062] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:32.245113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:32.295808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:32.307290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2ac4-e939-4665-809b-1c5a6dbd7534 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:32.311081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:32.311733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:32.312118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:32.312397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:32.372336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:32.373964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:32.384316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1023/2063] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:32.915465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f28ed8-91be-4661-b695-d4f35d9c2bb2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:32.928949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f28ed8-91be-4661-b695-d4f35d9c2bb2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:32.935061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105788-ab92-459b-8566-f47751aea99b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:32.935980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105788-ab92-459b-8566-f47751aea99b service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:32.936249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105788-ab92-459b-8566-f47751aea99b service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:32.936520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105788-ab92-459b-8566-f47751aea99b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:32.939003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e0105788-ab92-459b-8566-f47751aea99b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:33.043739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105788-ab92-459b-8566-f47751aea99b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:33.045329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105788-ab92-459b-8566-f47751aea99b service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:33.057067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1041/2064] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:38.421060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:38.422847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:38.492963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a362a-f6c7-4119-b29e-3f177e887bff service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:38.500460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:38.501636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:38.502041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:38.502318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] PATH_INFO: `/v3/users/b1bbe0b2fa0e47f896f6d26ac491be86` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:38.503571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bbe0b2fa0e47f896f6d26ac491be86)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:38.506030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:38.561413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bbe0b2fa0e47f896f6d26ac491be86'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:38.562228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bbe0b2fa0e47f896f6d26ac491be86'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:38.562879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bbe0b2fa0e47f896f6d26ac491be86'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:38.573186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bbe0b2fa0e47f896f6d26ac491be86'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:38.588322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bbe0b2fa0e47f896f6d26ac491be86'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:38.603547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1024/2065] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:38 2022] DELETE /identity/v3/users/b1bbe0b2fa0e47f896f6d26ac491be86 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:38.608238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:38.608811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:38.608927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:38.630687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:38.632012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:38.717405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1042/2066] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:38.727172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:38.728616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:38.753969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:38.862526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70867-0ea8-4bd2-9f88-dca89a3129aa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:38.866598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:38.867266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:38.867545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:38.867814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:38.878017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:38.879552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:38.891662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1025/2067] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:39.038369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.039885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:39.112093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2c5b-6414-4b4d-9976-6ffdc6c29988 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.117298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d766c6-de2e-4c22-a378-97b06c47cf15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.117883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d766c6-de2e-4c22-a378-97b06c47cf15 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.118157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d766c6-de2e-4c22-a378-97b06c47cf15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.118542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d766c6-de2e-4c22-a378-97b06c47cf15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.120835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-23d766c6-de2e-4c22-a378-97b06c47cf15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:39.160780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:39.200436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d766c6-de2e-4c22-a378-97b06c47cf15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.201981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d766c6-de2e-4c22-a378-97b06c47cf15 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.212815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1043/2068] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:39.264952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.266402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:39.280791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683af6c-891c-4859-8079-c75022cd2d43 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.298280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.300151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.300858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.301250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] PATH_INFO: `/v3/projects/97d11f42edcf4654b1bd781c420ed4dd` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.302854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d11f42edcf4654b1bd781c420ed4dd)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.305342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.366429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d11f42edcf4654b1bd781c420ed4dd', 'request_id': 'req-2d85265b-3346-4e77-91b8-8880def6fb22'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:39.372522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d11f42edcf4654b1bd781c420ed4dd', 'request_id': 'req-2d85265b-3346-4e77-91b8-8880def6fb22'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:39.378720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d11f42edcf4654b1bd781c420ed4dd', 'request_id': 'req-2d85265b-3346-4e77-91b8-8880def6fb22'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:39.394281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] The token cache is being invalidate because project 97d11f42edcf4654b1bd781c420ed4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:39.394569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:39.395202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d85265b-3346-4e77-91b8-8880def6fb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:39.396835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1026/2069] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:39 2022] DELETE /identity/v3/projects/97d11f42edcf4654b1bd781c420ed4dd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:39.402088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292d1df-af41-49e2-b28e-ae44426ba400 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.402371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292d1df-af41-49e2-b28e-ae44426ba400 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.402647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292d1df-af41-49e2-b28e-ae44426ba400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.420893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1292d1df-af41-49e2-b28e-ae44426ba400 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:39.422125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1292d1df-af41-49e2-b28e-ae44426ba400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:39.493517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1044/2070] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:39.502699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16f94d-abbf-4732-9c92-abbe46fd3b2a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.503146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16f94d-abbf-4732-9c92-abbe46fd3b2a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.503341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16f94d-abbf-4732-9c92-abbe46fd3b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.526526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dd16f94d-abbf-4732-9c92-abbe46fd3b2a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:39.526526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dd16f94d-abbf-4732-9c92-abbe46fd3b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:39.537144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1027/2071] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:39.542274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292d1df-af41-49e2-b28e-ae44426ba400 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.562049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292d1df-af41-49e2-b28e-ae44426ba400 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.562049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.562049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.562049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.562549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.562549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:39.562549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.563345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.576385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1045/2072] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:39.581019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16f94d-abbf-4732-9c92-abbe46fd3b2a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.591208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16f94d-abbf-4732-9c92-abbe46fd3b2a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.597414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.598212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.598478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.598841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.599676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.601766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.635905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1028/2073] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:39 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:39.637046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.648030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d71e-9610-4bdd-853d-cdaa53daaaae admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.715052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.715767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.716047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.716314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.717044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.718992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.740249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1046/2074] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:39 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:39.744462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.754733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679af9-2180-4ae7-a792-49a09b840b32 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.761156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.761807 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.762080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.762705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.763422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.765046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.775576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1029/2075] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:39.779607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.790415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200ede9-37b8-4057-8fed-f9f83284c0a2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.796052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342270d8-5210-453f-9181-d021bbbfd422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.796786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342270d8-5210-453f-9181-d021bbbfd422 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.797066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342270d8-5210-453f-9181-d021bbbfd422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.797335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342270d8-5210-453f-9181-d021bbbfd422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.798064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342270d8-5210-453f-9181-d021bbbfd422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.799679 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342270d8-5210-453f-9181-d021bbbfd422 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.812964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1047/2076] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:06:39.815290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:39.830182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c23c-9440-4d6d-87ad-9b165189039b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:39.835717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:39.836678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.836985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.837233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] PATH_INFO: `/v3/projects/1082ac24dda74201ab7a9bf670d83a38/users/f8e5131aab4e43a18d98e719e83d6268/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.853185 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1082ac24dda74201ab7a9bf670d83a38, user_id=f8e5131aab4e43a18d98e719e83d6268, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:39.855865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:39.871621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1030/2077] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:39 2022] PUT /identity/v3/projects/1082ac24dda74201ab7a9bf670d83a38/users/f8e5131aab4e43a18d98e719e83d6268/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:39.881580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:39.881580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:39.881580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:39.898797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:39.899991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:39.957808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:39.996412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1048/2078] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:40.005924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:40.008232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:40.064449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:40.094556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7aef-7f1a-44d5-9467-2e9b3c6daba7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:40.103343 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c891-68a3-44a1-b4f8-b1b3f2d46930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:40.103343 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c891-68a3-44a1-b4f8-b1b3f2d46930 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:40.103343 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c891-68a3-44a1-b4f8-b1b3f2d46930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:40.103343 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c891-68a3-44a1-b4f8-b1b3f2d46930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:40.114863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c891-68a3-44a1-b4f8-b1b3f2d46930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:40.116315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c891-68a3-44a1-b4f8-b1b3f2d46930 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:40.128691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1031/2079] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:40.255256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:40.257673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:40.279207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803af550-3dbd-48cd-9da0-dbf2c9912edd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:40.286870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:40.287817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:40.288164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:40.288486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] PATH_INFO: `/v3/users/7dbe87f393c441e3858148818b7cf6b9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:40.289883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbe87f393c441e3858148818b7cf6b9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:40.292032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:40.366484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbe87f393c441e3858148818b7cf6b9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:40.367682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbe87f393c441e3858148818b7cf6b9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:40.382017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbe87f393c441e3858148818b7cf6b9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:40.400743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbe87f393c441e3858148818b7cf6b9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:40.410915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbe87f393c441e3858148818b7cf6b9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:40.421340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1049/2080] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:40 2022] DELETE /identity/v3/users/7dbe87f393c441e3858148818b7cf6b9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:40.427164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:40.427631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:40.428089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:40.449702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:40.451027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:40.539032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1032/2081] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:40.551070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:40.552882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:40.652935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaebab9-8047-429d-bb9e-ed3224f3ba46 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:40.657472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6ee5-2bb6-42e2-8f7e-83975e95a9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:40.658378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6ee5-2bb6-42e2-8f7e-83975e95a9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:40.658496 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6ee5-2bb6-42e2-8f7e-83975e95a9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:40.658729 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6ee5-2bb6-42e2-8f7e-83975e95a9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:40.670032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6ee5-2bb6-42e2-8f7e-83975e95a9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:40.671695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6ee5-2bb6-42e2-8f7e-83975e95a9c1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:40.682278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1050/2082] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:41.039120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.040795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:41.054863 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e008fc2-8521-4b90-bea6-41b5fbef4142 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.060734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.061847 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.062366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.063111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] PATH_INFO: `/v3/projects/bd85d603f73f418b84874c1d0a3f44c3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.065053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd85d603f73f418b84874c1d0a3f44c3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.067440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.122770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd85d603f73f418b84874c1d0a3f44c3', 'request_id': 'req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.130002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd85d603f73f418b84874c1d0a3f44c3', 'request_id': 'req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.136483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd85d603f73f418b84874c1d0a3f44c3', 'request_id': 'req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.156231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] The token cache is being invalidate because project bd85d603f73f418b84874c1d0a3f44c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:41.156669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.158169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-69e79f4c-b94d-454c-b33b-6ee2fdec61e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.160059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1033/2083] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:41 2022] DELETE /identity/v3/projects/bd85d603f73f418b84874c1d0a3f44c3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:41.165077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.165665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.165918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.185532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:41.186734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:41.256192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:41.293604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1051/2084] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:41.308330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f15f1c-99f9-4357-b850-b107f355b140 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.308729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f15f1c-99f9-4357-b850-b107f355b140 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.309109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f15f1c-99f9-4357-b850-b107f355b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.344784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-89f15f1c-99f9-4357-b850-b107f355b140 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:41.345873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-89f15f1c-99f9-4357-b850-b107f355b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:41.348052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.352913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:41.357845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1034/2085] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:41.361816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f15f1c-99f9-4357-b850-b107f355b140 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.371403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8224188-a53f-43e6-aa90-17e82b209564 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.375076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f15f1c-99f9-4357-b850-b107f355b140 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.380354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.381342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.381845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.382280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.383225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:41.383701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.385795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.392407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.395660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.396017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.396366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] PATH_INFO: `/v3/users/2628840465524400a68b1e1f2a41b048` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.399633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2628840465524400a68b1e1f2a41b048)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.403574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.406122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1035/2086] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:41.411760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.423608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905e035-9587-459d-ba7f-f30f78bda4ba admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.454197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.455919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.456925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.457388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.458335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.460561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.514474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1036/2087] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:41 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:41.527288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.530639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2628840465524400a68b1e1f2a41b048'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.532315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2628840465524400a68b1e1f2a41b048'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.544154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2628840465524400a68b1e1f2a41b048'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.564240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2628840465524400a68b1e1f2a41b048'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.571690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:41.576754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0441f647-03cd-4976-a238-e5a767c3df72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2628840465524400a68b1e1f2a41b048'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:41.611761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1052/2088] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:41 2022] DELETE /identity/v3/users/2628840465524400a68b1e1f2a41b048 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:41.617090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4dd7-6b66-472f-bf84-072eae834612 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.618277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4dd7-6b66-472f-bf84-072eae834612 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.618894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4dd7-6b66-472f-bf84-072eae834612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.621838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754c57-bcf0-420e-af47-7accdac2ab5e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.648483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e1cc4dd7-6b66-472f-bf84-072eae834612 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:41.650201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e1cc4dd7-6b66-472f-bf84-072eae834612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:41.700581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.701718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.702086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.702458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.703392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.706638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.749696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1037/2089] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:41 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:41.751988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.758756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:41.777330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e98f86-5e44-4d9e-bbeb-32b467ddfb20 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.782851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.783929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.784427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.785000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.786610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.788618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.792351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1053/2090] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:41.802852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1038/2091] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:41.807818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4dd7-6b66-472f-bf84-072eae834612 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.808010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.811675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:41.820327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4dd7-6b66-472f-bf84-072eae834612 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.833955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.835156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.835998 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.836277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.838909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.841724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.858599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1054/2092] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:41.876434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:41.905148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aad302-54db-41bd-9da8-7a3bd0319c52 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.914248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.915184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.917888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.918223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] PATH_INFO: `/v3/projects/e8d175006f054c8998eb3b20a01d7e52/users/4a1292fd47234e178e0330a213ad01ec/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.936384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55207504-90a5-46cf-9df6-2a112303a0a0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:41.943208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b2dfe-b3fa-4f9b-b2de-cd8159697dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:41.944019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b2dfe-b3fa-4f9b-b2de-cd8159697dbe service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.946303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b2dfe-b3fa-4f9b-b2de-cd8159697dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.946678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b2dfe-b3fa-4f9b-b2de-cd8159697dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:41.953637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d175006f054c8998eb3b20a01d7e52, user_id=4a1292fd47234e178e0330a213ad01ec, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.957673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.964203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b2dfe-b3fa-4f9b-b2de-cd8159697dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:41.965950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b2dfe-b3fa-4f9b-b2de-cd8159697dbe service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:41.991538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1039/2094] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:41.991994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1055/2094] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:41 2022] PUT /identity/v3/projects/e8d175006f054c8998eb3b20a01d7e52/users/4a1292fd47234e178e0330a213ad01ec/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:41.993711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993dc52-49e4-4d38-b76a-c61cf5cd86c7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:41.993999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993dc52-49e4-4d38-b76a-c61cf5cd86c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:41.994272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993dc52-49e4-4d38-b76a-c61cf5cd86c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.047838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8993dc52-49e4-4d38-b76a-c61cf5cd86c7 None None] MFA Rules not processed for user `4a1292fd47234e178e0330a213ad01ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:42.049607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8993dc52-49e4-4d38-b76a-c61cf5cd86c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:42.146296 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:42.224298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1040/2095] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:42.228534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.275861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:42.346155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0150c-0ade-46fe-bcaa-412ac7ebeb12 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:42.354315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:42.355108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:42.355421 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:42.356036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.357105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:42.359296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:42.400717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1056/2096] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:42 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:42.403618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993dc52-49e4-4d38-b76a-c61cf5cd86c7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.415422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993dc52-49e4-4d38-b76a-c61cf5cd86c7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:42.497543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.499542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:42.527178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:42.538356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:42.538890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:42.539722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.551866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:42.554292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:42.594697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1041/2097] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:42 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:42.595839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.597165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c319c9-f5a5-41c1-9023-dc0bc277c170 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:42.601868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:42.603016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:42.603125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:42.603314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] PATH_INFO: `/v3/users/3fc0a97d39d04020b8f933dbd5a57933` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.604716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc0a97d39d04020b8f933dbd5a57933)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:42.606674 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:42.607674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e659-8277-4697-a42f-873ccd00fba7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:42.612124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:42.613215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:42.613502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:42.614104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.614849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:42.616473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:42.629637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1042/2098] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:42.633575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.645128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608f7cb-2063-4214-8909-15b22cdd5ebc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:42.650059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:42.650718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:42.650999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:42.651266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.652004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:42.653684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:42.664430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc0a97d39d04020b8f933dbd5a57933'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:42.665063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc0a97d39d04020b8f933dbd5a57933'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:42.667848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1043/2099] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:42.671885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.680519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc0a97d39d04020b8f933dbd5a57933'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:42.684149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f4767-1939-4294-adde-79ac187668c8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:42.689389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:42.690352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:42.690693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:42.690962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] PATH_INFO: `/v3/projects/eae9e7bedcd44270908ac380dd020c76/users/9b0c13edec8b441da15de0034e63d8b8/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.708907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae9e7bedcd44270908ac380dd020c76, user_id=9b0c13edec8b441da15de0034e63d8b8, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:42.711859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:42.719063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc0a97d39d04020b8f933dbd5a57933'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:42.727203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3efd2018-c2d7-453f-9054-91b1e14852be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc0a97d39d04020b8f933dbd5a57933'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:42.739791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1057/2100] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:42 2022] DELETE /identity/v3/users/3fc0a97d39d04020b8f933dbd5a57933 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:42.763606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1044/2101] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:42 2022] PUT /identity/v3/projects/eae9e7bedcd44270908ac380dd020c76/users/9b0c13edec8b441da15de0034e63d8b8/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:42.774117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:42.774436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:42.774678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:42.806169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] MFA Rules not processed for user `9b0c13edec8b441da15de0034e63d8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:42.807475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:42.839778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:42.851487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.854236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:42.959933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1058/2102] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:42.964693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:42.969362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:42.994189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b110a-63c3-4ab5-ab65-f850ba9eb0a7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.052373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:43.105707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.106766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.107052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.107564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] PATH_INFO: `/v3/projects/6bc69ff322e44b6bbb16f61a74cbf806` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.108992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc69ff322e44b6bbb16f61a74cbf806)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.111075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:43.111224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc7eef-c913-4755-a420-d5e85975cd85 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.119801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.120490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.120805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.121116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.121764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.123931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:43.179614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1059/2103] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:42 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:43.180664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:43.184730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.185086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc69ff322e44b6bbb16f61a74cbf806', 'request_id': 'req-c40eaca8-80ea-4832-847e-77f86f2ff7bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.191288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc69ff322e44b6bbb16f61a74cbf806', 'request_id': 'req-c40eaca8-80ea-4832-847e-77f86f2ff7bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.199163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc69ff322e44b6bbb16f61a74cbf806', 'request_id': 'req-c40eaca8-80ea-4832-847e-77f86f2ff7bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.217891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] The token cache is being invalidate because project 6bc69ff322e44b6bbb16f61a74cbf806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:43.218597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.220125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.223342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1045/2104] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:42 2022] DELETE /identity/v3/projects/6bc69ff322e44b6bbb16f61a74cbf806 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:43.236900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:43.240587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.276219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd0ed1-d9cb-4511-a4f0-dedb05a4af6f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.282868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.283787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.284250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.284587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] PATH_INFO: `/v3/projects/bb8c6f8383ec43868ace8748bdd3946b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.285891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8c6f8383ec43868ace8748bdd3946b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.288420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:43.349080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eaca8-80ea-4832-847e-77f86f2ff7bb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.376407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8c6f8383ec43868ace8748bdd3946b', 'request_id': 'req-d0d227fc-6386-4962-ab2e-1099ae0db701'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.377808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:43.387004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8c6f8383ec43868ace8748bdd3946b', 'request_id': 'req-d0d227fc-6386-4962-ab2e-1099ae0db701'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.401603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8c6f8383ec43868ace8748bdd3946b', 'request_id': 'req-d0d227fc-6386-4962-ab2e-1099ae0db701'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.433162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] The token cache is being invalidate because project bb8c6f8383ec43868ace8748bdd3946b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:43.433875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.437944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.440116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1060/2105] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:43 2022] DELETE /identity/v3/projects/bb8c6f8383ec43868ace8748bdd3946b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:43.445260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:43.451011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.506073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf18e-0ca9-4a05-9e9f-ff5ccfc08f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.506828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf18e-0ca9-4a05-9e9f-ff5ccfc08f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.507116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf18e-0ca9-4a05-9e9f-ff5ccfc08f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.507394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf18e-0ca9-4a05-9e9f-ff5ccfc08f18 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.509229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf18e-0ca9-4a05-9e9f-ff5ccfc08f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.515730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf18e-0ca9-4a05-9e9f-ff5ccfc08f18 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:43.554451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:43.560582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1046/2106] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:43 2022] POST /identity/v3/users => generated 299 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:43.566087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.566087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.566469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.584936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d227fc-6386-4962-ab2e-1099ae0db701 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.593700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.595216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.596089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.596377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] PATH_INFO: `/v3/users/4f53e1d8ab504461be1b12aa71df4789` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.599004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f53e1d8ab504461be1b12aa71df4789)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.602053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:43.607789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:43.612291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.640971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1047/2107] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:43.642245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:43.644700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.667040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7358-f814-44da-b846-fb1315bf71fb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.674329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2cd41-f2dd-4877-9abe-76bd9f1f5435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.675358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2cd41-f2dd-4877-9abe-76bd9f1f5435 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.675999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2cd41-f2dd-4877-9abe-76bd9f1f5435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.676580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2cd41-f2dd-4877-9abe-76bd9f1f5435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.678099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2cd41-f2dd-4877-9abe-76bd9f1f5435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.680087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2cd41-f2dd-4877-9abe-76bd9f1f5435 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:43.694858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1048/2108] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:43.694858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c80-b6b7-4fc0-a8bc-83d791bf63ff None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.694858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c80-b6b7-4fc0-a8bc-83d791bf63ff None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.694858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c80-b6b7-4fc0-a8bc-83d791bf63ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.706262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f53e1d8ab504461be1b12aa71df4789'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.707325 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f53e1d8ab504461be1b12aa71df4789'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.719042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f37c0c80-b6b7-4fc0-a8bc-83d791bf63ff None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:43.720662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f37c0c80-b6b7-4fc0-a8bc-83d791bf63ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.723318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f53e1d8ab504461be1b12aa71df4789'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.730961 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1049/2109] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:43.735392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c0c80-b6b7-4fc0-a8bc-83d791bf63ff None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:43.744136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f53e1d8ab504461be1b12aa71df4789'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.755138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f53e1d8ab504461be1b12aa71df4789'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:43.759843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c0c80-b6b7-4fc0-a8bc-83d791bf63ff None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.763185 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1061/2110] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:43 2022] DELETE /identity/v3/users/4f53e1d8ab504461be1b12aa71df4789 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:43.768195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.769455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.769751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.770221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] PATH_INFO: `/v3/projects/fdc452b159aa44588e42b447721f4444/users/202dfda9a4794c7c8d614f845b5846f9/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.786475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:43.793721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.799883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc452b159aa44588e42b447721f4444, user_id=202dfda9a4794c7c8d614f845b5846f9, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.803735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:43.832732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1050/2111] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:43 2022] PUT /identity/v3/projects/fdc452b159aa44588e42b447721f4444/users/202dfda9a4794c7c8d614f845b5846f9/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:43.834371 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:43.838872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:43.903423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:43.917723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dd895-f930-4ea0-a087-00276a5baa93 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.964087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b66283-4e2b-4b91-82de-83302a7d7922 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:43.979259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:43.979947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:43.980220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:43.980485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:43.981352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:43.982893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.009444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1051/2112] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:44.014528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.015960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.017767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.017767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.017767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.018819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:44.019196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.021200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.029075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098143c6-0926-407e-9829-0171c6b9d1e5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.036398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf12397-4e85-4ec5-867e-d12e83132a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.038446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12397-4e85-4ec5-867e-d12e83132a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.039498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12397-4e85-4ec5-867e-d12e83132a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.039498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12397-4e85-4ec5-867e-d12e83132a91 admin admin] PATH_INFO: `/v3/projects/fdc452b159aa44588e42b447721f4444/users/202dfda9a4794c7c8d614f845b5846f9/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.041222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1062/2113] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:44.042481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf12397-4e85-4ec5-867e-d12e83132a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc452b159aa44588e42b447721f4444, user_id=202dfda9a4794c7c8d614f845b5846f9, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.045568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.047264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf12397-4e85-4ec5-867e-d12e83132a91 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.066741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1052/2114] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:44 2022] PUT /identity/v3/projects/fdc452b159aa44588e42b447721f4444/users/202dfda9a4794c7c8d614f845b5846f9/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:44.069400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c1677-4408-4a17-8c01-4d300c24fd50 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.077653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.078246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.078793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.128898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] MFA Rules not processed for user `202dfda9a4794c7c8d614f845b5846f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:44.130895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.136963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.138258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.138541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.138812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.140021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.142211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.205035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1063/2115] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:44 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:44.205979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.240352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1053/2116] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:44.253489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.255824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.289649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:44.344420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139211f-b31f-4a20-9a02-3753594e8e4b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.376888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9db26-f971-4ee7-ba8a-246832bc1251 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.382816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.383994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.384477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.384973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.386203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.389669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.419499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1064/2117] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:44 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:44.420779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.422557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.433577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.434242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.434668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.434954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.435306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d00fd-aab5-4a21-b781-5d8213a737c2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.436859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.440103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.441043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.441494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.441884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] PATH_INFO: `/v3/projects/7eaf89c54ab44e6ea7cac70cca160be9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.443119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eaf89c54ab44e6ea7cac70cca160be9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.445859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.456052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:44.528216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eaf89c54ab44e6ea7cac70cca160be9', 'request_id': 'req-7240ad7e-d12f-4fe6-995d-7b22373b4279'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.534944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eaf89c54ab44e6ea7cac70cca160be9', 'request_id': 'req-7240ad7e-d12f-4fe6-995d-7b22373b4279'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.543862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eaf89c54ab44e6ea7cac70cca160be9', 'request_id': 'req-7240ad7e-d12f-4fe6-995d-7b22373b4279'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.552149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.554756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.565440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1054/2118] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:44.566355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.566761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] The token cache is being invalidate because project 7eaf89c54ab44e6ea7cac70cca160be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:44.567237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.568664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.570519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1065/2119] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:44 2022] DELETE /identity/v3/projects/7eaf89c54ab44e6ea7cac70cca160be9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:44.572886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.574285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.580432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f534dc1-a24a-4fd5-9081-f914e7328e60 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.677955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.678523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240ad7e-d12f-4fe6-995d-7b22373b4279 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.680293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.680409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.680770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.681526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.683228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.699460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1055/2120] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:44.700527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.701681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.702594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.703759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.705531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.707317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] PATH_INFO: `/v3/users/99229b4c83a34782a4ba080be30b1cfa` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.712028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=99229b4c83a34782a4ba080be30b1cfa)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.714443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.717898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6e9c9-8497-4fe5-90a2-5bb69f8463a7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:44.724619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:44.726080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.726508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.726978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] PATH_INFO: `/v3/users/9f548f28075548459a135dbaa27c2057` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.728571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f548f28075548459a135dbaa27c2057)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:44.731666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:44.762560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:44.808711 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f548f28075548459a135dbaa27c2057'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.810995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f548f28075548459a135dbaa27c2057'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.811856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f548f28075548459a135dbaa27c2057'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.826897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f548f28075548459a135dbaa27c2057'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.834121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99229b4c83a34782a4ba080be30b1cfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.835341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99229b4c83a34782a4ba080be30b1cfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.849397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99229b4c83a34782a4ba080be30b1cfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.866085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f548f28075548459a135dbaa27c2057'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.874206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99229b4c83a34782a4ba080be30b1cfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.890316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-211d67f2-380d-45cb-ba38-62715fdb8eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99229b4c83a34782a4ba080be30b1cfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:44.895500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1056/2121] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:44 2022] DELETE /identity/v3/users/9f548f28075548459a135dbaa27c2057 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:44.898518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:44.901455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.904785 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1066/2122] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:44 2022] DELETE /identity/v3/users/99229b4c83a34782a4ba080be30b1cfa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:44.910177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:44.910522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:44.910860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:44.947192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:44.951119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:44.971440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:45.039974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2353865-fc9f-4cce-9da1-11338a09dd8d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:45.056622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1067/2123] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:45.090360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:45.091968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:45.165935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:45.167390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:45.167543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:45.167706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:45.169869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:45.175013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:45.208611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1057/2124] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:45.210606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:45.212924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:45.237934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3ea88-c56a-4a64-a897-0a6b372f64f6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:45.244503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940d26c-8ac7-45df-aff2-51ea9cf4e9c3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:45.249327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df973cea-45cd-420f-9bd0-92a72ba461f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:45.249991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df973cea-45cd-420f-9bd0-92a72ba461f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:45.250268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df973cea-45cd-420f-9bd0-92a72ba461f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:45.250537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df973cea-45cd-420f-9bd0-92a72ba461f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:45.251688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:45.253159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:45.253452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:45.253737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] PATH_INFO: `/v3/projects/c58531997aad4383bc42f30e954576ad/users/c10be41ba79648b3939b11b76bd0b9d4/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:45.261873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df973cea-45cd-420f-9bd0-92a72ba461f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:45.266354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df973cea-45cd-420f-9bd0-92a72ba461f6 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:45.276134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1068/2125] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:45.290168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58531997aad4383bc42f30e954576ad, user_id=c10be41ba79648b3939b11b76bd0b9d4, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:45.294099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:45.332466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1058/2126] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:45 2022] PUT /identity/v3/projects/c58531997aad4383bc42f30e954576ad/users/c10be41ba79648b3939b11b76bd0b9d4/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:45.335532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975617-4b8c-432f-97c8-2834b09716e0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:45.336235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975617-4b8c-432f-97c8-2834b09716e0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:45.336235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975617-4b8c-432f-97c8-2834b09716e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:45.373765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b9975617-4b8c-432f-97c8-2834b09716e0 None None] MFA Rules not processed for user `c10be41ba79648b3939b11b76bd0b9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:45.375014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b9975617-4b8c-432f-97c8-2834b09716e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:45.491198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1069/2127] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:45.496604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:45.533162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:45.640910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8376a7-32c4-4a64-842e-03f8de3a68ee admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:45.657463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:45.658333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:45.658591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:45.658888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:45.659663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:45.662274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:45.724349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1059/2128] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:45 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:45.725423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9975617-4b8c-432f-97c8-2834b09716e0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:45.728964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:45.735407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:45.746147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9975617-4b8c-432f-97c8-2834b09716e0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:45.855701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:45.876462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4058e0f-cad7-4764-964f-836a4c267843 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:45.877015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:45.878013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:45.878627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:45.879094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:45.880484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:45.881960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:45.882912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:45.883881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:45.884334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:45.884870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] PATH_INFO: `/v3/projects/874624a18e7c4796a7304db67c8bcd37` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:45.889189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=874624a18e7c4796a7304db67c8bcd37)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:45.891467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:45.922635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1070/2129] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:45 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:06:45.931057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:45.954016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46261f6-a4e6-4e2e-8a4e-b5e7dafc454e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:45.982646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874624a18e7c4796a7304db67c8bcd37', 'request_id': 'req-b9960474-caac-4748-be87-decfde8ae97c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:45.990919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874624a18e7c4796a7304db67c8bcd37', 'request_id': 'req-b9960474-caac-4748-be87-decfde8ae97c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.002378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874624a18e7c4796a7304db67c8bcd37', 'request_id': 'req-b9960474-caac-4748-be87-decfde8ae97c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.025480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] The token cache is being invalidate because project 874624a18e7c4796a7304db67c8bcd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:46.025809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.027826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.030168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1060/2130] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:45 2022] DELETE /identity/v3/projects/874624a18e7c4796a7304db67c8bcd37 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:46.030943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.036252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.041537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac46c-c0a5-4e19-8158-5fec306a5f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.042229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac46c-c0a5-4e19-8158-5fec306a5f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.042507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac46c-c0a5-4e19-8158-5fec306a5f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.042768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac46c-c0a5-4e19-8158-5fec306a5f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.043619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac46c-c0a5-4e19-8158-5fec306a5f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.045664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac46c-c0a5-4e19-8158-5fec306a5f56 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:46.056676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9960474-caac-4748-be87-decfde8ae97c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.059949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1071/2131] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:46.059949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.059949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.059949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.069817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.070637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.070921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.071293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] PATH_INFO: `/v3/projects/899fdc60018b4f8484dc4665ca737c9d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.072434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899fdc60018b4f8484dc4665ca737c9d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.074984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:46.082085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:46.083341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.096270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1072/2132] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:46.104256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.105677 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.120263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:46.124054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec3f34-d6ee-4d72-ad6f-01c314886e16 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.146146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899fdc60018b4f8484dc4665ca737c9d', 'request_id': 'req-bc017cf6-3b30-4734-8992-bccb15176a40'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.155985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899fdc60018b4f8484dc4665ca737c9d', 'request_id': 'req-bc017cf6-3b30-4734-8992-bccb15176a40'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.162918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899fdc60018b4f8484dc4665ca737c9d', 'request_id': 'req-bc017cf6-3b30-4734-8992-bccb15176a40'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.184397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] The token cache is being invalidate because project 899fdc60018b4f8484dc4665ca737c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:46.184731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.185659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc017cf6-3b30-4734-8992-bccb15176a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.188691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1061/2133] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:46 2022] DELETE /identity/v3/projects/899fdc60018b4f8484dc4665ca737c9d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:46.189113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.189446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.189728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.238309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:46.238988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.239383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.240305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.240581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.242435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] PATH_INFO: `/v3/projects/669b05e74250480f9712be2a43d7eb48/users/776b3e0e7edc4069b450b6835a785103/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.267792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1062/2134] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:46.268731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.270855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.324135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=669b05e74250480f9712be2a43d7eb48, user_id=776b3e0e7edc4069b450b6835a785103, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.327108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:46.331012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a6b22-bda6-4ba6-9a2a-775a199a2dca None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.343483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.344482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.344842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.345318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] PATH_INFO: `/v3/users/8c660c10f44249e8a538c30e467fe79d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.347033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c660c10f44249e8a538c30e467fe79d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.350652 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:46.384452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1073/2135] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:46 2022] PUT /identity/v3/projects/669b05e74250480f9712be2a43d7eb48/users/776b3e0e7edc4069b450b6835a785103/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:46.388471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.481444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c660c10f44249e8a538c30e467fe79d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.483105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c660c10f44249e8a538c30e467fe79d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.483796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c660c10f44249e8a538c30e467fe79d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.510466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c660c10f44249e8a538c30e467fe79d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.535799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c660c10f44249e8a538c30e467fe79d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:46.551469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:46.565030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1063/2136] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:46 2022] DELETE /identity/v3/users/8c660c10f44249e8a538c30e467fe79d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:46.566032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.567476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.578505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669a33b-6e03-47fa-be66-bfbeb15bde7e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.711983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.713958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.714243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.714514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.715266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:46.715573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.717290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:46.736334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2011c-9220-4b4a-b3db-00d828662ef7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.742013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.743933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.743933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.743933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.743933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.745561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:46.750767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1074/2137] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:46.751818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.756617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.774516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1064/2138] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:46.775380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.777100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.803158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d5e04-1874-4821-afba-c0917ee2c5a2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.806774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.807444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.807723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.807992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.808717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.810648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:46.854616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:46.892443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1065/2139] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:46 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:46.893418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:46.913179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1af191-ab5b-493c-aa3b-f0bff8a4f35d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.972218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.972948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.973176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.973448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.975599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:46.984879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd827f-0eda-4ad1-8db1-e06d1c9ab078 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:46.990146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d003bf-fe00-4bdf-b4f1-4e475946199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:46.991205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d003bf-fe00-4bdf-b4f1-4e475946199e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:46.991317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d003bf-fe00-4bdf-b4f1-4e475946199e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:46.991755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d003bf-fe00-4bdf-b4f1-4e475946199e admin admin] PATH_INFO: `/v3/projects/669b05e74250480f9712be2a43d7eb48/users/776b3e0e7edc4069b450b6835a785103/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:46.995895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d003bf-fe00-4bdf-b4f1-4e475946199e admin admin] RBAC: Authorizing `identity:create_grant(project_id=669b05e74250480f9712be2a43d7eb48, user_id=776b3e0e7edc4069b450b6835a785103, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:46.998798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d003bf-fe00-4bdf-b4f1-4e475946199e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.026619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1066/2140] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:46 2022] PUT /identity/v3/projects/669b05e74250480f9712be2a43d7eb48/users/776b3e0e7edc4069b450b6835a785103/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:47.028142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2947b-7bc9-4eb8-8cf0-d5c4dfaf11ec None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.028536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2947b-7bc9-4eb8-8cf0-d5c4dfaf11ec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.028846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2947b-7bc9-4eb8-8cf0-d5c4dfaf11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.055985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.061593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.083553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1075/2141] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:47.085321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cae2947b-7bc9-4eb8-8cf0-d5c4dfaf11ec None None] MFA Rules not processed for user `f8e5131aab4e43a18d98e719e83d6268`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:47.086958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cae2947b-7bc9-4eb8-8cf0-d5c4dfaf11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.096301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.130096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:47.139667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f05c4-310d-4d34-9cb3-f5b4182aa810 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.224473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1067/2142] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:47.226507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.226796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.227074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.229857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.230536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.230849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.231086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.231879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.234038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.267332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1076/2143] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:47.270033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.272653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] MFA Rules not processed for user `776b3e0e7edc4069b450b6835a785103`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:47.273988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.278425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.293017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00be69-6449-4acc-9e1e-7ac14823bdef admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.303305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.304767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.305194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.305830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] PATH_INFO: `/v3/projects/64ca7d0f315e4c4d8c249283058f3993` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.309322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ca7d0f315e4c4d8c249283058f3993)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.311453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.366590 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1068/2144] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:47.367303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ca7d0f315e4c4d8c249283058f3993', 'request_id': 'req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:47.367421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.368883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.373965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ca7d0f315e4c4d8c249283058f3993', 'request_id': 'req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:47.379076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:47.381853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ca7d0f315e4c4d8c249283058f3993', 'request_id': 'req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:47.384026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657778d-1cd5-4937-b0f3-4ba918725362 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.401428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] The token cache is being invalidate because project 64ca7d0f315e4c4d8c249283058f3993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:47.401907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:47.403030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:47.408733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1077/2145] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:47 2022] DELETE /identity/v3/projects/64ca7d0f315e4c4d8c249283058f3993 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:47.409614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.413697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.458111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.459104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.459268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.459580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.461004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.464607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.503347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1069/2146] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:47.504556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.509062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.515487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ea2c-bfe2-465e-b1e5-918c9d8f569b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.541063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:47.577362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0bbd-d2ce-4781-a961-536f669c833e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.581624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.582352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.582698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.583027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.584994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.602611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082e4d6-acf1-476e-b690-512644509b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.603965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e4d6-acf1-476e-b690-512644509b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.604279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e4d6-acf1-476e-b690-512644509b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.604706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e4d6-acf1-476e-b690-512644509b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.609760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082e4d6-acf1-476e-b690-512644509b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.610892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082e4d6-acf1-476e-b690-512644509b3e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.645214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1078/2147] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:47.647512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50770-08e0-4da3-8192-a0968dc5a6a4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.647807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50770-08e0-4da3-8192-a0968dc5a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.648081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50770-08e0-4da3-8192-a0968dc5a6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.650205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.651691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.666497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1070/2148] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:47.667326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.669913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.673515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-88a50770-08e0-4da3-8192-a0968dc5a6a4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:47.674792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-88a50770-08e0-4da3-8192-a0968dc5a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.684688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1079/2149] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:47.685593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50770-08e0-4da3-8192-a0968dc5a6a4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.695294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66963cc-a56f-4b37-9692-9ffa6f230444 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.696478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50770-08e0-4da3-8192-a0968dc5a6a4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.706293 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.706436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236a386-df42-4dcc-b8e5-16e293fc9803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.706541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.706616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a386-df42-4dcc-b8e5-16e293fc9803 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.706693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.706775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a386-df42-4dcc-b8e5-16e293fc9803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.706775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236a386-df42-4dcc-b8e5-16e293fc9803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.706924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.707006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a386-df42-4dcc-b8e5-16e293fc9803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.707085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.707154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236a386-df42-4dcc-b8e5-16e293fc9803 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.714502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.719582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1080/2150] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:47.723205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9451c32-9413-49b0-bbee-46b5c0bb6136 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.723797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9451c32-9413-49b0-bbee-46b5c0bb6136 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.723949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9451c32-9413-49b0-bbee-46b5c0bb6136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.746396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1071/2151] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/users => generated 292 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:47.747231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.768248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fd2f-65d9-42ff-b134-e0522761567f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.777005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f9451c32-9413-49b0-bbee-46b5c0bb6136 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:47.781947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.782882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.783164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.783271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f9451c32-9413-49b0-bbee-46b5c0bb6136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.783427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] PATH_INFO: `/v3/projects/618d63d2b1bc47e9828c3467048497d6/users/a73a79f26ef94bc797011c8d8b0d728c/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.793492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1081/2152] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:47.794356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9451c32-9413-49b0-bbee-46b5c0bb6136 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.803767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] RBAC: Authorizing `identity:create_grant(project_id=618d63d2b1bc47e9828c3467048497d6, user_id=a73a79f26ef94bc797011c8d8b0d728c, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.806469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.808971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9451c32-9413-49b0-bbee-46b5c0bb6136 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.814489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d126050-ba7a-44c9-a098-66333abff522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.815446 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126050-ba7a-44c9-a098-66333abff522 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.815752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126050-ba7a-44c9-a098-66333abff522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.816303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126050-ba7a-44c9-a098-66333abff522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.818067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d126050-ba7a-44c9-a098-66333abff522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.820981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d126050-ba7a-44c9-a098-66333abff522 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.837430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1072/2153] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:47 2022] PUT /identity/v3/projects/618d63d2b1bc47e9828c3467048497d6/users/a73a79f26ef94bc797011c8d8b0d728c/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:47.837430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.842356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:47.843244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1082/2154] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:47.844995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.845277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.846457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.879632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] MFA Rules not processed for user `a73a79f26ef94bc797011c8d8b0d728c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:47.881131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.927903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3251-664b-4ffc-946d-fc290773976e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.933013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.933680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.933957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.934243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:47.934946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:47.935249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:47.936901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:47.949852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1073/2155] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:47.955226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.960612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1083/2156] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:47.964728 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:47.965245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:47.967831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d695b-f565-4abf-845c-dfe230d0f6e2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:47.972827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:47.973779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:47.974053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:47.974318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] PATH_INFO: `/v3/projects/52d2993f1b7046c987e930d6590dfd5d/users/d968471a36654dc4af66b1d03eb73b0a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.003428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2993f1b7046c987e930d6590dfd5d, user_id=d968471a36654dc4af66b1d03eb73b0a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.006665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.022153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1074/2157] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:47 2022] PUT /identity/v3/projects/52d2993f1b7046c987e930d6590dfd5d/users/d968471a36654dc4af66b1d03eb73b0a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:48.022845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.054192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751f1af-d5b8-4b94-8c2a-7b1c85e88b10 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.089771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:48.107927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7e07-e6c6-478e-87b4-3ee2e5ad13f6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.113106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.113878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.114229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.114586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.115360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.117515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.119632 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.120341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.120697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.120981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.122998 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:48.151028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1075/2158] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:48 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:48.151028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.200262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.201781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.210729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4307205-b5e0-4fa7-838a-77882bd271ee admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.212249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1084/2159] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:48.213148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.214619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.215357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.215705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.216058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.224294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b536e-d3e5-46f2-9fe3-ef6021599a4e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.228892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:48.299801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.300106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.302380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.303524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.303524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.303524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.304290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.306317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.318903 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1076/2160] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:48.320125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.329976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1085/2161] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:48.331016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.334093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d75a5d-3d23-4f01-bc49-3ee997657067 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.343099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.343295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7259b1-667f-491e-9c21-3ebf647ca6aa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.343953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.344289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.344569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.345427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.347671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.348778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.349849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.350031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.350460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] PATH_INFO: `/v3/projects/52d2993f1b7046c987e930d6590dfd5d/users/d968471a36654dc4af66b1d03eb73b0a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.352700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2993f1b7046c987e930d6590dfd5d, user_id=d968471a36654dc4af66b1d03eb73b0a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.355843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.384217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1086/2162] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:48 2022] PUT /identity/v3/projects/52d2993f1b7046c987e930d6590dfd5d/users/d968471a36654dc4af66b1d03eb73b0a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:48.393743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1077/2163] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:48 2022] POST /identity/v3/users => generated 281 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:48.396615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.491541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428307e-0819-4dc9-906b-fb8668072428 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.504622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.505758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.507693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.508417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.511361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.515720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.520684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:48.535641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1087/2164] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:48.536940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.549559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccce91-814c-4d7c-84ba-511ad86350be admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.556785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5855f8-b4a1-4de8-83ac-afda2a5093a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.557922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5855f8-b4a1-4de8-83ac-afda2a5093a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.558188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5855f8-b4a1-4de8-83ac-afda2a5093a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.558460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5855f8-b4a1-4de8-83ac-afda2a5093a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.559576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5855f8-b4a1-4de8-83ac-afda2a5093a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.561600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5855f8-b4a1-4de8-83ac-afda2a5093a3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.575119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1078/2165] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:48.579681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:48.593131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d413bf-15ff-4f67-86e1-12bf87216abe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:48.603054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:48.604565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.604906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.605537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] PATH_INFO: `/v3/projects/8e6f6ba76f8b46ed8d6de9e86b29b5d7/users/b095b89258f04067b7c8137586a93aa0/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.634232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6f6ba76f8b46ed8d6de9e86b29b5d7, user_id=b095b89258f04067b7c8137586a93aa0, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:48.639137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:48.664299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1088/2166] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:48 2022] PUT /identity/v3/projects/8e6f6ba76f8b46ed8d6de9e86b29b5d7/users/b095b89258f04067b7c8137586a93aa0/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:48.683392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22175-ae24-40cf-b916-77196d3635bb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:48.684524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22175-ae24-40cf-b916-77196d3635bb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:48.685032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb22175-ae24-40cf-b916-77196d3635bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:48.758385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9eb22175-ae24-40cf-b916-77196d3635bb None None] MFA Rules not processed for user `b095b89258f04067b7c8137586a93aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:48.759876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9eb22175-ae24-40cf-b916-77196d3635bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:48.915814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1079/2167] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:48.953764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:49.058456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f03e06-528f-4f86-a925-13e62dbc34db admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:49.062956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e6ee-a12f-4079-89ff-ffb9e068e49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:49.063647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e6ee-a12f-4079-89ff-ffb9e068e49d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:49.063928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e6ee-a12f-4079-89ff-ffb9e068e49d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:49.064201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e6ee-a12f-4079-89ff-ffb9e068e49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:49.075016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191e6ee-a12f-4079-89ff-ffb9e068e49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:49.076490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191e6ee-a12f-4079-89ff-ffb9e068e49d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:49.089738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1089/2168] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:49.105598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22175-ae24-40cf-b916-77196d3635bb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:49.185754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb22175-ae24-40cf-b916-77196d3635bb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:49.191101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:49.192132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:49.192415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:49.192732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] PATH_INFO: `/v3/users/b095b89258f04067b7c8137586a93aa0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:49.194255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b095b89258f04067b7c8137586a93aa0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:49.195870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:49.227984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:49.295635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b095b89258f04067b7c8137586a93aa0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:49.296699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b095b89258f04067b7c8137586a93aa0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:49.297766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b095b89258f04067b7c8137586a93aa0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:49.308036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b095b89258f04067b7c8137586a93aa0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:49.323467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b095b89258f04067b7c8137586a93aa0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:49.341526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1080/2169] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:49 2022] DELETE /identity/v3/users/b095b89258f04067b7c8137586a93aa0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:49.347005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:49.347809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:49.348238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:49.377315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:49.379529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:49.538320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1090/2170] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:49.551096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:49.553793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:49.644046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42d2c-32e1-4c29-a864-cd0bcc7fc583 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:49.649357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2aba-86a8-4b6b-b340-5e3ef86ce5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:49.650189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2aba-86a8-4b6b-b340-5e3ef86ce5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:49.650526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2aba-86a8-4b6b-b340-5e3ef86ce5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:49.650856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2aba-86a8-4b6b-b340-5e3ef86ce5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:49.664941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2aba-86a8-4b6b-b340-5e3ef86ce5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:49.667628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2aba-86a8-4b6b-b340-5e3ef86ce5b2 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:49.685344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1081/2171] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:50.230271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:50.231894 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:50.251885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677630-943c-4c76-85e5-679e22224f62 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:50.258924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:50.259951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.260240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.260822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] PATH_INFO: `/v3/projects/8e6f6ba76f8b46ed8d6de9e86b29b5d7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.262586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6f6ba76f8b46ed8d6de9e86b29b5d7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:50.264800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:50.372590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6f6ba76f8b46ed8d6de9e86b29b5d7', 'request_id': 'req-25cf398d-2247-4dde-a2a2-828397fa97c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:50.379570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6f6ba76f8b46ed8d6de9e86b29b5d7', 'request_id': 'req-25cf398d-2247-4dde-a2a2-828397fa97c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:50.386534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6f6ba76f8b46ed8d6de9e86b29b5d7', 'request_id': 'req-25cf398d-2247-4dde-a2a2-828397fa97c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:50.399801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:50.405994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] The token cache is being invalidate because project 8e6f6ba76f8b46ed8d6de9e86b29b5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:50.406203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:50.407273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25cf398d-2247-4dde-a2a2-828397fa97c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:50.410019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1091/2172] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:50 2022] DELETE /identity/v3/projects/8e6f6ba76f8b46ed8d6de9e86b29b5d7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:50.415564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0bc85-0d76-4181-9801-eb18e9566aa4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.416115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0bc85-0d76-4181-9801-eb18e9566aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.416115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0bc85-0d76-4181-9801-eb18e9566aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.435944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-aae0bc85-0d76-4181-9801-eb18e9566aa4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:50.437121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aae0bc85-0d76-4181-9801-eb18e9566aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:50.522242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1082/2173] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:50.529786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218fab-ed1f-4f85-8f83-c117ac47380e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.530075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218fab-ed1f-4f85-8f83-c117ac47380e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.530363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218fab-ed1f-4f85-8f83-c117ac47380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.548684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-52218fab-ed1f-4f85-8f83-c117ac47380e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:50.549951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-52218fab-ed1f-4f85-8f83-c117ac47380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:50.560539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1092/2174] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:50.564992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0bc85-0d76-4181-9801-eb18e9566aa4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:50.577399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0bc85-0d76-4181-9801-eb18e9566aa4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:50.582665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:50.583356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.583803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.584199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.585224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:50.585755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:50.587833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:50.609131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1083/2175] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:50.616393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52218fab-ed1f-4f85-8f83-c117ac47380e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:50.631536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52218fab-ed1f-4f85-8f83-c117ac47380e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:50.637315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:50.638274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.638534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.638871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.639718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:50.642082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:50.685576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1093/2176] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:50 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:50.690385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:50.702374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47684bdd-fdc9-483a-be18-5c143d570a4e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:50.732166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:50.781950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:50.782701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.783079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.783400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.784169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:50.786486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:50.816884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1084/2177] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:50 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:50.818873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:50.832191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd9bd5-74bb-4ae9-93be-e6fce16e97fa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:50.839447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:50.841090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.841562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.842161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.843776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:50.845509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:50.860487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1094/2178] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:50.863337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:50.874284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8bc43-75b6-4bbe-b8e9-56ad80477d98 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:50.883972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7b7e-5ff1-4bd4-b13e-4c2384a529eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:50.885791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7b7e-5ff1-4bd4-b13e-4c2384a529eb admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.886094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7b7e-5ff1-4bd4-b13e-4c2384a529eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.886392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7b7e-5ff1-4bd4-b13e-4c2384a529eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:50.888043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b7b7e-5ff1-4bd4-b13e-4c2384a529eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:50.893465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b7b7e-5ff1-4bd4-b13e-4c2384a529eb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:50.913629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1085/2179] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:50.917642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:50.942702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249f6a-c55c-4e29-a499-f7059d169b0c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:50.970070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:50.971020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:50.971343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:50.971602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] PATH_INFO: `/v3/projects/d3cbdf111cfe44dfb2fb391249248a84/users/d30ccd15b228495c9404458c641bd45a/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:51.010733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cbdf111cfe44dfb2fb391249248a84, user_id=d30ccd15b228495c9404458c641bd45a, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:51.015060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:51.042083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1095/2180] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:50 2022] PUT /identity/v3/projects/d3cbdf111cfe44dfb2fb391249248a84/users/d30ccd15b228495c9404458c641bd45a/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:51.054346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729fd0-36da-478d-8ddc-f5971b5516e0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:51.054647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729fd0-36da-478d-8ddc-f5971b5516e0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:51.057849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729fd0-36da-478d-8ddc-f5971b5516e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:51.097651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ff729fd0-36da-478d-8ddc-f5971b5516e0 None None] MFA Rules not processed for user `d30ccd15b228495c9404458c641bd45a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:51.099259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ff729fd0-36da-478d-8ddc-f5971b5516e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:51.213662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1086/2181] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:51.221167 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:51.224793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:51.319955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3127d23-a7b7-4b63-a7ba-226879ed4bcd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:51.324688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc7650-0db5-4e02-a3b3-e8d8722ebe71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:51.325377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7650-0db5-4e02-a3b3-e8d8722ebe71 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:51.326016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7650-0db5-4e02-a3b3-e8d8722ebe71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:51.326295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7650-0db5-4e02-a3b3-e8d8722ebe71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:51.339065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7650-0db5-4e02-a3b3-e8d8722ebe71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:51.340560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7650-0db5-4e02-a3b3-e8d8722ebe71 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:51.354517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1096/2182] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:51.379860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff729fd0-36da-478d-8ddc-f5971b5516e0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:51.521629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff729fd0-36da-478d-8ddc-f5971b5516e0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:51.547241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:51.548236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:51.548568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:51.548934 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] PATH_INFO: `/v3/users/d30ccd15b228495c9404458c641bd45a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:51.557546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30ccd15b228495c9404458c641bd45a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:51.561650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:51.647708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:51.674889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30ccd15b228495c9404458c641bd45a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:51.675978 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30ccd15b228495c9404458c641bd45a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:51.678147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30ccd15b228495c9404458c641bd45a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:51.694463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30ccd15b228495c9404458c641bd45a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:51.710419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30ccd15b228495c9404458c641bd45a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:51.738317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1087/2183] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:51 2022] DELETE /identity/v3/users/d30ccd15b228495c9404458c641bd45a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:51.742876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:51.743170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:51.743441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:51.774102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:51.775984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:51.857020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1097/2184] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:51.863393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:51.865314 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:51.971437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a5c2-de27-43f7-b0d1-fdd2fb293c67 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:51.975745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94687d-398b-43ba-8d3c-5bd0af51c2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:51.977627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94687d-398b-43ba-8d3c-5bd0af51c2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:51.978152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94687d-398b-43ba-8d3c-5bd0af51c2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:51.978644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94687d-398b-43ba-8d3c-5bd0af51c2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:51.990657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94687d-398b-43ba-8d3c-5bd0af51c2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:51.992266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94687d-398b-43ba-8d3c-5bd0af51c2b4 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:52.015827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1088/2185] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:52.701211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:52.702786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:52.717853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c34721-d789-4359-84f8-1a8984f3033c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:52.723361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:52.724330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:52.724709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:52.725055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] PATH_INFO: `/v3/projects/d3cbdf111cfe44dfb2fb391249248a84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:52.726479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cbdf111cfe44dfb2fb391249248a84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:52.728568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:52.834868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:52.868158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cbdf111cfe44dfb2fb391249248a84', 'request_id': 'req-bd92c0ea-c001-4a78-b233-661312a16bbd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:52.886324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cbdf111cfe44dfb2fb391249248a84', 'request_id': 'req-bd92c0ea-c001-4a78-b233-661312a16bbd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:52.900286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cbdf111cfe44dfb2fb391249248a84', 'request_id': 'req-bd92c0ea-c001-4a78-b233-661312a16bbd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:52.936952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] The token cache is being invalidate because project d3cbdf111cfe44dfb2fb391249248a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:52.937288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:52.939938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd92c0ea-c001-4a78-b233-661312a16bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:52.943878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1098/2186] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:52 2022] DELETE /identity/v3/projects/d3cbdf111cfe44dfb2fb391249248a84 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:52.950948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebcff-5e4f-437d-96ba-f6bf880d0358 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:52.951425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebcff-5e4f-437d-96ba-f6bf880d0358 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:52.951695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ebcff-5e4f-437d-96ba-f6bf880d0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:52.975495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6c3ebcff-5e4f-437d-96ba-f6bf880d0358 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:52.977092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6c3ebcff-5e4f-437d-96ba-f6bf880d0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:53.073611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1089/2187] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:53.076312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9525-60f8-4aff-a766-fe09a1d6dc7c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.076621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9525-60f8-4aff-a766-fe09a1d6dc7c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.076962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9525-60f8-4aff-a766-fe09a1d6dc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.119694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-562e9525-60f8-4aff-a766-fe09a1d6dc7c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:53.121168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-562e9525-60f8-4aff-a766-fe09a1d6dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:53.144050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1099/2188] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:53.148047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ebcff-5e4f-437d-96ba-f6bf880d0358 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:53.159456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ebcff-5e4f-437d-96ba-f6bf880d0358 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:53.170067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:53.171260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.171744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.172747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.174223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:53.174700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:53.177243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:53.210562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1090/2189] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:53.214779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9525-60f8-4aff-a766-fe09a1d6dc7c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:53.227508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9525-60f8-4aff-a766-fe09a1d6dc7c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:53.245973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:53.246680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.246967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.247236 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.247950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:53.250696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:53.348135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1100/2190] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:53 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:53.349501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:53.387610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6f2b-d98b-49e1-86ec-058a40536fc5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:53.531178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:53.586268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:53.586962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.587438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.587725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.588419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:53.590446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:53.605975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:53.609865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:53.629939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74dfe4-b27f-4fa5-8fa7-7304adbddd9f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:53.647626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1091/2191] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:53 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:53.649392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:53.650332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:53.651732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.652365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.654789 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] PATH_INFO: `/v3/users/a73a79f26ef94bc797011c8d8b0d728c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.656392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73a79f26ef94bc797011c8d8b0d728c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:53.662414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:53.673338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880411f-1e10-4f51-b1d5-aab344b03794 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:53.687206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:53.687952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.688224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.688501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.689271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:53.693109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:53.725168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1092/2192] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:53.732147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:53.754111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86bff-8377-4166-83b1-5cfa86f00072 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:53.762596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:53.763378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.763775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.764138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.765018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:53.766486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73a79f26ef94bc797011c8d8b0d728c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:53.767499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:53.769149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73a79f26ef94bc797011c8d8b0d728c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:53.788921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73a79f26ef94bc797011c8d8b0d728c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:53.803608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1093/2193] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:53.808729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:53.808878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73a79f26ef94bc797011c8d8b0d728c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:53.823965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781dbb9-cf16-42df-a320-abf2a260c337 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:53.826560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-36c26a42-2cb9-4a01-960c-588db2c9a8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73a79f26ef94bc797011c8d8b0d728c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:53.838563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1101/2194] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:53 2022] DELETE /identity/v3/users/a73a79f26ef94bc797011c8d8b0d728c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:53.843539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.844726 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.846522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e294461-6dc4-4b21-a600-7865156db1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:53.847634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294461-6dc4-4b21-a600-7865156db1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.848080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.849993 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294461-6dc4-4b21-a600-7865156db1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.850377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294461-6dc4-4b21-a600-7865156db1ab admin admin] PATH_INFO: `/v3/projects/92c49142ea324049ba24b55ff84e5a3b/users/d059ba56941148f3bb6080ba4f537f9d/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.904966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e294461-6dc4-4b21-a600-7865156db1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c49142ea324049ba24b55ff84e5a3b, user_id=d059ba56941148f3bb6080ba4f537f9d, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:53.911109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:53.913292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:53.915023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e294461-6dc4-4b21-a600-7865156db1ab admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:53.964484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1094/2195] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:53 2022] PUT /identity/v3/projects/92c49142ea324049ba24b55ff84e5a3b/users/d059ba56941148f3bb6080ba4f537f9d/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:53.969897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:53.970291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:53.970684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:53.998224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:54.000927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:54.044305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1102/2196] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:54.054063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:54.056400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:54.074015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:54.137822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1095/2197] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:54.139424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:54.140915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:54.174838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175abb9-ba8f-42b7-a134-9122ff63f117 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:54.237736 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88321cfd-7492-42e9-8fc7-9a9c0f073f19 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:54.243692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114cbf1-3f07-481c-8b84-19f867e04eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:54.244618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114cbf1-3f07-481c-8b84-19f867e04eba service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:54.245033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114cbf1-3f07-481c-8b84-19f867e04eba service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:54.245428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114cbf1-3f07-481c-8b84-19f867e04eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:54.248108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5114cbf1-3f07-481c-8b84-19f867e04eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:54.294255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:54.294881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:54.295179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:54.300355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:54.320202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:54.321979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:54.323129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:54.344946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1103/2198] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:54.345900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:54.359162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114cbf1-3f07-481c-8b84-19f867e04eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:54.359752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac70dc-ce05-44a6-a7c6-ac4d10ab8043 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:54.362211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114cbf1-3f07-481c-8b84-19f867e04eba service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:54.378048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:54.378725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:54.379002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:54.380411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:54.391680 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1096/2199] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:54.397439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:54.398906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:54.436681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1104/2200] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:54.626755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:54.627534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:54.628155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:54.676172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] MFA Rules not processed for user `d968471a36654dc4af66b1d03eb73b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:54.677602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:54.827481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1097/2201] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:54.842148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:54.844232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.016181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1654cb-a062-47ca-8c47-ccb67bd2a2a0 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:55.023564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:55.024351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.025343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.025730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.028038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.087831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:55.091482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.117384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c929ae9-b5a3-440c-81fd-0b2ac618f009 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:55.135213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:55.138384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.138810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.139493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] PATH_INFO: `/v3/projects/618d63d2b1bc47e9828c3467048497d6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.146206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618d63d2b1bc47e9828c3467048497d6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:55.151053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:55.173777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:55.186895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:55.188528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:55.199944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1105/2202] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:55.201407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:55.203338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.225040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8132-c080-4553-b309-9958c8177782 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:55.239951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618d63d2b1bc47e9828c3467048497d6', 'request_id': 'req-cb22f17b-ad23-4244-b79f-7df0447510b6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.249796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618d63d2b1bc47e9828c3467048497d6', 'request_id': 'req-cb22f17b-ad23-4244-b79f-7df0447510b6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.259775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618d63d2b1bc47e9828c3467048497d6', 'request_id': 'req-cb22f17b-ad23-4244-b79f-7df0447510b6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.295079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] The token cache is being invalidate because project 618d63d2b1bc47e9828c3467048497d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:55.295473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.296301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cb22f17b-ad23-4244-b79f-7df0447510b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.301993 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1098/2203] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:55 2022] DELETE /identity/v3/projects/618d63d2b1bc47e9828c3467048497d6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:55.308148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5533ff-0500-4586-8a82-0db3a7ffb064 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.308501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5533ff-0500-4586-8a82-0db3a7ffb064 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.308843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5533ff-0500-4586-8a82-0db3a7ffb064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.350695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-de5533ff-0500-4586-8a82-0db3a7ffb064 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:55.353074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-de5533ff-0500-4586-8a82-0db3a7ffb064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.398570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:55.399494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.399862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.400151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] PATH_INFO: `/v3/users/4a1292fd47234e178e0330a213ad01ec` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.402680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1292fd47234e178e0330a213ad01ec)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:55.408491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:55.444659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:55.477967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1099/2204] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:55.488728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee6fa3-1dba-467b-beb9-b31110e517fc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.489054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee6fa3-1dba-467b-beb9-b31110e517fc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.489297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee6fa3-1dba-467b-beb9-b31110e517fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.521302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1292fd47234e178e0330a213ad01ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.525190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1292fd47234e178e0330a213ad01ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.539260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1292fd47234e178e0330a213ad01ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.556544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-96ee6fa3-1dba-467b-beb9-b31110e517fc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:55.557946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-96ee6fa3-1dba-467b-beb9-b31110e517fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.560060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1292fd47234e178e0330a213ad01ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.568212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-256be2ed-38ec-46c1-aa67-e9f2c9ccb603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1292fd47234e178e0330a213ad01ec'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:55.575973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1106/2205] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:55 2022] DELETE /identity/v3/users/4a1292fd47234e178e0330a213ad01ec => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:55.577102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1100/2206] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:55.579617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee6fa3-1dba-467b-beb9-b31110e517fc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:55.581152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.581813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.582335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.590216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee6fa3-1dba-467b-beb9-b31110e517fc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:55.621742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:55.624858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.687281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:55.688963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.689267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.689537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.690390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:55.690747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:55.692390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:55.713689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1101/2207] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:06:55.715970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:55.718198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.731354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1107/2208] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:55.738222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a3f10-f5ad-42c7-88a8-e5f6d114e786 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:55.746893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:55.747208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.747491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.747764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.748461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:55.750589 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:55.756474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:55.759735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:55.780355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:55.804809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1102/2209] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:55 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:55.807670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:55.904924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c74d6c-4a08-4e29-ad0b-33b573ddf909 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:55.931670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d333164-5f55-4e2b-9824-96b5b17334fa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:55.947247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e191f-eba2-4049-97f7-eb035d4e2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:55.947247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e191f-eba2-4049-97f7-eb035d4e2714 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:55.947247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e191f-eba2-4049-97f7-eb035d4e2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:55.947247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e191f-eba2-4049-97f7-eb035d4e2714 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:55.947800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e191f-eba2-4049-97f7-eb035d4e2714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:55.947800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e191f-eba2-4049-97f7-eb035d4e2714 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.012397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.013463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.013945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.014987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.021676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1103/2210] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:55 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:56.021676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.024115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.024552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.031742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.034271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.047376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1108/2211] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:56.049067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:56.063015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6010fb8-6d98-4581-9505-4705e0308739 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:56.070205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.071065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.071352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.071655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.072611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.074467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.090851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1109/2212] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:56.091919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:56.092542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] MFA Rules not processed for user `d059ba56941148f3bb6080ba4f537f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:56.097460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:56.110844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5a1e6-74b5-4719-b450-65f0209af16b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:56.135705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.136851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.140028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.140414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.141377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.144148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.164304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1110/2213] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:56.171067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:56.177504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:56.207834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709319a-3424-4edf-8248-0ccba6a9da58 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:56.223703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e1077-9a1f-40d0-97da-6d0c1dd2ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.224670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1077-9a1f-40d0-97da-6d0c1dd2ffc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.225283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1077-9a1f-40d0-97da-6d0c1dd2ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.225283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1077-9a1f-40d0-97da-6d0c1dd2ffc3 admin admin] PATH_INFO: `/v3/projects/b7ffaf0276394eafb5a4ee10ef3ab4d7/users/19ccb0e5ef064cfda61c913034da54a6/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.273222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e1077-9a1f-40d0-97da-6d0c1dd2ffc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ffaf0276394eafb5a4ee10ef3ab4d7, user_id=19ccb0e5ef064cfda61c913034da54a6, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.279066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e1077-9a1f-40d0-97da-6d0c1dd2ffc3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.313763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1111/2214] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:56 2022] PUT /identity/v3/projects/b7ffaf0276394eafb5a4ee10ef3ab4d7/users/19ccb0e5ef064cfda61c913034da54a6/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:56.320227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.320707 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.321024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.322084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1104/2215] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:56.337194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:56.338954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:56.364235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:56.370274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:56.461553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881e9c3-5f1e-46e1-a10f-683f216ec87e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:56.506634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1112/2216] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:06:56.508094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:56.528858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:56.551398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270f10-843b-4df7-9bfd-f4958bd60afb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:56.552001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.552811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.553095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.553370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.557091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.558120 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.558624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.559100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] PATH_INFO: `/v3/projects/e8d175006f054c8998eb3b20a01d7e52` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.563214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d175006f054c8998eb3b20a01d7e52)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.566607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.604935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:56.633983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.635943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.658484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1105/2217] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:06:56.659673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:56.663561 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d175006f054c8998eb3b20a01d7e52', 'request_id': 'req-6f064e07-4700-4413-9be6-735126fd28df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:56.664614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:56.679184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d175006f054c8998eb3b20a01d7e52', 'request_id': 'req-6f064e07-4700-4413-9be6-735126fd28df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:56.692278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d175006f054c8998eb3b20a01d7e52', 'request_id': 'req-6f064e07-4700-4413-9be6-735126fd28df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:56.731705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] The token cache is being invalidate because project e8d175006f054c8998eb3b20a01d7e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:56.731982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:56.733002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:56.734921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1113/2218] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:56 2022] DELETE /identity/v3/projects/e8d175006f054c8998eb3b20a01d7e52 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:56.739403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:56.743444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:56.763683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:56.797054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51dd49-0ff7-4a7a-83d1-88dd5f177680 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:56.867420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f064e07-4700-4413-9be6-735126fd28df admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:56.872331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.873724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.874021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.874297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] PATH_INFO: `/v3/users/9b0c13edec8b441da15de0034e63d8b8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.876220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0c13edec8b441da15de0034e63d8b8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.879373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.901517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259d7a-50ea-4dff-921d-b94002df21da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:56.903198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259d7a-50ea-4dff-921d-b94002df21da service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.903633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259d7a-50ea-4dff-921d-b94002df21da service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.903918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259d7a-50ea-4dff-921d-b94002df21da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.906811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c0259d7a-50ea-4dff-921d-b94002df21da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:56.922760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259d7a-50ea-4dff-921d-b94002df21da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:56.924496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259d7a-50ea-4dff-921d-b94002df21da service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:56.944489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1106/2219] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:06:56.967160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0c13edec8b441da15de0034e63d8b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:56.969576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0c13edec8b441da15de0034e63d8b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:56.991303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c91d9-d81c-4beb-af07-17ce0bd9dfc6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:56.992033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c91d9-d81c-4beb-af07-17ce0bd9dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:56.992381 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c91d9-d81c-4beb-af07-17ce0bd9dfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:56.998817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0c13edec8b441da15de0034e63d8b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:57.033581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d29c91d9-d81c-4beb-af07-17ce0bd9dfc6 None None] MFA Rules not processed for user `f8e5131aab4e43a18d98e719e83d6268`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:57.045215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0c13edec8b441da15de0034e63d8b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:57.046600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d29c91d9-d81c-4beb-af07-17ce0bd9dfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:57.058852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0c13edec8b441da15de0034e63d8b8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:57.083941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1114/2220] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:56 2022] DELETE /identity/v3/users/9b0c13edec8b441da15de0034e63d8b8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:57.227035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1107/2221] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:57.739502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:57.741030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:57.790721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:57.860547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d616b-0560-41f7-a9ca-9f11e24cc4d9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:57.867168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:57.868433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:57.868804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:57.869076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] PATH_INFO: `/v3/projects/eae9e7bedcd44270908ac380dd020c76` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:57.870372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae9e7bedcd44270908ac380dd020c76)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:57.874013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:57.989420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae9e7bedcd44270908ac380dd020c76', 'request_id': 'req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.001973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae9e7bedcd44270908ac380dd020c76', 'request_id': 'req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.015469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae9e7bedcd44270908ac380dd020c76', 'request_id': 'req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.044704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] The token cache is being invalidate because project eae9e7bedcd44270908ac380dd020c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:58.045513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.046481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.055837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1115/2222] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:57 2022] DELETE /identity/v3/projects/eae9e7bedcd44270908ac380dd020c76 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:58.060929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c91d9-d81c-4beb-af07-17ce0bd9dfc6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:58.072948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c91d9-d81c-4beb-af07-17ce0bd9dfc6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:58.151181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:58.152198 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:58.152549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:58.153036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] PATH_INFO: `/v3/users/202dfda9a4794c7c8d614f845b5846f9` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:58.154558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202dfda9a4794c7c8d614f845b5846f9)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:58.156669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:58.235663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:58.240273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202dfda9a4794c7c8d614f845b5846f9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.241617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202dfda9a4794c7c8d614f845b5846f9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.242640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202dfda9a4794c7c8d614f845b5846f9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.253443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202dfda9a4794c7c8d614f845b5846f9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.270876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a10e8b2-fefa-4d4c-9ca3-08190bdae240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202dfda9a4794c7c8d614f845b5846f9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:58.286315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1108/2223] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:06:58 2022] DELETE /identity/v3/users/202dfda9a4794c7c8d614f845b5846f9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:06:58.789724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:58.791841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:58.813231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febb78f-5491-4c3b-a4b1-cbc0bea47dce admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:58.965897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:58.968108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:58.968108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:58.968108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] PATH_INFO: `/v3/projects/fdc452b159aa44588e42b447721f4444` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:58.969787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc452b159aa44588e42b447721f4444)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:58.973503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:59.074375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc452b159aa44588e42b447721f4444', 'request_id': 'req-c0f7abcf-1785-4b91-b605-137f770786b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:59.089793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:59.102392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc452b159aa44588e42b447721f4444', 'request_id': 'req-c0f7abcf-1785-4b91-b605-137f770786b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:59.121509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc452b159aa44588e42b447721f4444', 'request_id': 'req-c0f7abcf-1785-4b91-b605-137f770786b5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:59.151758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] The token cache is being invalidate because project fdc452b159aa44588e42b447721f4444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:06:59.152053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:59.157350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c0f7abcf-1785-4b91-b605-137f770786b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:06:59.161553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1116/2224] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:06:58 2022] DELETE /identity/v3/projects/fdc452b159aa44588e42b447721f4444 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:06:59.166382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030cbb-247a-456a-a479-98fb404f7aab None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.166717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030cbb-247a-456a-a479-98fb404f7aab None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.167003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030cbb-247a-456a-a479-98fb404f7aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.190162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d4030cbb-247a-456a-a479-98fb404f7aab None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:59.191519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d4030cbb-247a-456a-a479-98fb404f7aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:59.346771 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1109/2225] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:59.354083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6f94-7664-40a1-9bda-125f4c5dca1d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.354595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6f94-7664-40a1-9bda-125f4c5dca1d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.355104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6f94-7664-40a1-9bda-125f4c5dca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.369894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6401-6010-4d41-bd7b-7c4858296609 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.373879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6401-6010-4d41-bd7b-7c4858296609 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.374151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6401-6010-4d41-bd7b-7c4858296609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.425225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9bfc6f94-7664-40a1-9bda-125f4c5dca1d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:59.426475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9bfc6f94-7664-40a1-9bda-125f4c5dca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:59.452490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d6ae6401-6010-4d41-bd7b-7c4858296609 None None] MFA Rules not processed for user `d059ba56941148f3bb6080ba4f537f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:06:59.455021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d6ae6401-6010-4d41-bd7b-7c4858296609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:06:59.459266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1117/2226] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:59.476917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6f94-7664-40a1-9bda-125f4c5dca1d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:59.493198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6f94-7664-40a1-9bda-125f4c5dca1d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:59.503709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:59.504192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.504476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.504777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.505533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:06:59.505841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:59.515495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:59.571374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1118/2227] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:06:59.575900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:59.595308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56925fe7-d111-4a86-adb9-608732f1bcf9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:59.622944 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:59.624569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.625378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.628733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.630439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:59.634062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:59.640594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1110/2228] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:06:59.704536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1119/2229] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:06:59 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:59.709616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae6401-6010-4d41-bd7b-7c4858296609 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:59.735648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae6401-6010-4d41-bd7b-7c4858296609 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:59.842338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:59.845957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.846441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.847038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.848424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:59.851147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:59.864178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:06:59.887671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1111/2230] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:06:59 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:06:59.890520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:59.903447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfdf66-9f95-4063-bea5-1a7cb3c460b5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:59.908403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:59.909288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.909716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.909996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.918893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:59.920859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:59.940498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1120/2231] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:06:59.948669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:06:59.961080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7c051-1564-48bc-a5e5-308d8d136379 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:06:59.969936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ab5b3-63f1-4081-afee-11dcf42e9711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:06:59.971563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab5b3-63f1-4081-afee-11dcf42e9711 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:06:59.972712 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab5b3-63f1-4081-afee-11dcf42e9711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:06:59.973242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab5b3-63f1-4081-afee-11dcf42e9711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:06:59.974827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ab5b3-63f1-4081-afee-11dcf42e9711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:06:59.977620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ab5b3-63f1-4081-afee-11dcf42e9711 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:06:59.996414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:00.006005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1112/2232] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:00.013685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988acb-0f54-4427-848b-75f841f483f0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:00.023232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:00.024504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:00.024831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:00.025103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] PATH_INFO: `/v3/projects/99c5725383e84ebea4a4aaed91598a18/users/3ec3996d0f6049b5afbe3b58eb232225/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:00.063308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c5725383e84ebea4a4aaed91598a18, user_id=3ec3996d0f6049b5afbe3b58eb232225, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:00.066546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:00.087527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1121/2233] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:06:59 2022] PUT /identity/v3/projects/99c5725383e84ebea4a4aaed91598a18/users/3ec3996d0f6049b5afbe3b58eb232225/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:00.097956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834f786-5625-4b39-8442-de384bbf85fa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:00.098247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834f786-5625-4b39-8442-de384bbf85fa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:00.098527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834f786-5625-4b39-8442-de384bbf85fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:00.167542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2834f786-5625-4b39-8442-de384bbf85fa None None] MFA Rules not processed for user `3ec3996d0f6049b5afbe3b58eb232225`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:00.168864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2834f786-5625-4b39-8442-de384bbf85fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:00.278818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1113/2234] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:00.291365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:00.294006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:00.382380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affce50-9846-4110-ab85-ad77bcb57bbc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:00.386108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:00.387204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:00.387549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:00.387890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:00.397364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:00.398806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:00.408468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1122/2235] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:03.164457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73158d54-cf4f-4119-b47b-3650a2feb58c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:03.165081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73158d54-cf4f-4119-b47b-3650a2feb58c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:03.165232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73158d54-cf4f-4119-b47b-3650a2feb58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:03.193339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-73158d54-cf4f-4119-b47b-3650a2feb58c None None] MFA Rules not processed for user `19ccb0e5ef064cfda61c913034da54a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:03.194552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-73158d54-cf4f-4119-b47b-3650a2feb58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:03.268673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1114/2236] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:03.273882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:03.275898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:03.354201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f65b-2451-4a55-8a89-d710b7aeda76 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:03.358923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:03.359685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:03.360036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:03.360369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:03.361198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:03.363214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:03.384276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:03.408080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1123/2237] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:03 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:03.412062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73158d54-cf4f-4119-b47b-3650a2feb58c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:03.427055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73158d54-cf4f-4119-b47b-3650a2feb58c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:03.492683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:03.493280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:03.493749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:03.494102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:03.495078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:03.500569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:03.509871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:03.524584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1115/2238] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:03 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:03.528602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:03.539268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771af133-b989-41ed-8922-6ce53a060966 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:03.543832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:03.544515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:03.544883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:03.545163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:03.546017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:03.547723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:03.559507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1124/2239] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:03.563735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:03.574216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7845-07d5-4fe8-bb5c-73d45668f87d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:03.578916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:03.579816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:03.580123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:03.580392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] PATH_INFO: `/v3/projects/8c0aac5837d8498498cd815f58d2e5a8/users/705b3c087ded4f2ea9c1cd5c98f7600b/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:03.596885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0aac5837d8498498cd815f58d2e5a8, user_id=705b3c087ded4f2ea9c1cd5c98f7600b, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:03.599813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:03.618773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1116/2240] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:03 2022] PUT /identity/v3/projects/8c0aac5837d8498498cd815f58d2e5a8/users/705b3c087ded4f2ea9c1cd5c98f7600b/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:03.622594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:03.633461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5ebb-3e15-4f5a-91c1-51d094072d12 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:03.701514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c03a43-48a3-4ae1-8375-4217fa7537ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:03.702221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03a43-48a3-4ae1-8375-4217fa7537ea admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:03.702542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03a43-48a3-4ae1-8375-4217fa7537ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:03.702841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03a43-48a3-4ae1-8375-4217fa7537ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:03.703579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c03a43-48a3-4ae1-8375-4217fa7537ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:03.705312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c03a43-48a3-4ae1-8375-4217fa7537ea admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:03.715694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1125/2241] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:03.719997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:03.731173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76d34a-f56c-4ef5-9bff-3eb3eab78f15 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:03.736034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd48ddb-c6e6-489e-a9ae-ec0e8bcd5211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:03.737034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48ddb-c6e6-489e-a9ae-ec0e8bcd5211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:03.737506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48ddb-c6e6-489e-a9ae-ec0e8bcd5211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:03.737790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48ddb-c6e6-489e-a9ae-ec0e8bcd5211 admin admin] PATH_INFO: `/v3/projects/8c0aac5837d8498498cd815f58d2e5a8/users/705b3c087ded4f2ea9c1cd5c98f7600b/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:03.739846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd48ddb-c6e6-489e-a9ae-ec0e8bcd5211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0aac5837d8498498cd815f58d2e5a8, user_id=705b3c087ded4f2ea9c1cd5c98f7600b, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:03.742586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd48ddb-c6e6-489e-a9ae-ec0e8bcd5211 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:03.754233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1117/2242] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:03 2022] PUT /identity/v3/projects/8c0aac5837d8498498cd815f58d2e5a8/users/705b3c087ded4f2ea9c1cd5c98f7600b/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:05.310401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:05.311857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:05.312626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:05.347662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] MFA Rules not processed for user `3ec3996d0f6049b5afbe3b58eb232225`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:05.350347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:05.484992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1126/2243] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:11.202113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:11.202583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:11.202801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:11.267306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] MFA Rules not processed for user `705b3c087ded4f2ea9c1cd5c98f7600b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:11.269912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:11.383571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1118/2244] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:11.399805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:11.402475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:11.551807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd0a51-1155-4faf-8954-5680f38d8f1f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:11.558579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843195-9307-4986-9ea4-5c3d11290780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:11.559395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843195-9307-4986-9ea4-5c3d11290780 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:11.559992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843195-9307-4986-9ea4-5c3d11290780 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:11.560457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843195-9307-4986-9ea4-5c3d11290780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:11.592528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:11.644835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843195-9307-4986-9ea4-5c3d11290780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:11.647098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843195-9307-4986-9ea4-5c3d11290780 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:11.660616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1127/2245] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:21.380688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=3,keystone:SELECT=51 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:21.654722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=17 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:21.990941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:21.992485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:22.155101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0cf8c-1aa6-4437-8931-0808388d40d1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:22.164256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:22.165153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:22.165500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:22.165767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] PATH_INFO: `/v3/users/c10be41ba79648b3939b11b76bd0b9d4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:22.166979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10be41ba79648b3939b11b76bd0b9d4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:22.168936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:22.217496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10be41ba79648b3939b11b76bd0b9d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:22.218324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10be41ba79648b3939b11b76bd0b9d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:22.219332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10be41ba79648b3939b11b76bd0b9d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:22.228358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10be41ba79648b3939b11b76bd0b9d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:22.246652 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10be41ba79648b3939b11b76bd0b9d4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:22.259832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1119/2246] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:21 2022] DELETE /identity/v3/users/c10be41ba79648b3939b11b76bd0b9d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:22.264573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:22.265025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:22.265393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:22.298157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:22.299659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:22.419466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1128/2247] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:22.433304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:22.434830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:22.463180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:22.589307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92130-904d-43e2-a8ec-750bebde69d7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:22.598165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:22.599182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:22.599621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:22.600217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:22.616777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:22.618698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:22.633503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1120/2248] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:23.074869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:23.076475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:23.094735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64832247-b655-4c1a-9ebf-f7ca531a525a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:23.108461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:23.109141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:23.109466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:23.109754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] PATH_INFO: `/v3/projects/c58531997aad4383bc42f30e954576ad` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:23.111206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58531997aad4383bc42f30e954576ad)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:23.113510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:23.204183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58531997aad4383bc42f30e954576ad', 'request_id': 'req-78a14885-02e8-42f4-ba00-d8b45df336e4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.215996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58531997aad4383bc42f30e954576ad', 'request_id': 'req-78a14885-02e8-42f4-ba00-d8b45df336e4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.225139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58531997aad4383bc42f30e954576ad', 'request_id': 'req-78a14885-02e8-42f4-ba00-d8b45df336e4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.252383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] The token cache is being invalidate because project c58531997aad4383bc42f30e954576ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:23.253687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.254533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.258568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1129/2249] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:23 2022] DELETE /identity/v3/projects/c58531997aad4383bc42f30e954576ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:23.263179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:23.275242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd39bb7-d4df-4ed0-8a98-c4f1a9bec36a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:23.369870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:23.370897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:23.371266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:23.371735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] PATH_INFO: `/v3/users/776b3e0e7edc4069b450b6835a785103` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:23.373125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776b3e0e7edc4069b450b6835a785103)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:23.375396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:23.430696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776b3e0e7edc4069b450b6835a785103'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.431191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776b3e0e7edc4069b450b6835a785103'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.431943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776b3e0e7edc4069b450b6835a785103'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.446349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776b3e0e7edc4069b450b6835a785103'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.463310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-eccaffcd-bba2-4ffe-9a88-6de03fe1cad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776b3e0e7edc4069b450b6835a785103'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:23.477891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1121/2250] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:23 2022] DELETE /identity/v3/users/776b3e0e7edc4069b450b6835a785103 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:23.965398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:23.967165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:23.983851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14885-02e8-42f4-ba00-d8b45df336e4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:24.057970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:24.059078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.061114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.061400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] PATH_INFO: `/v3/projects/669b05e74250480f9712be2a43d7eb48` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.062913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=669b05e74250480f9712be2a43d7eb48)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:24.064936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:24.094377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:24.139481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669b05e74250480f9712be2a43d7eb48', 'request_id': 'req-d6993090-1fe2-4fef-83ff-eedcf98c70dc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:24.149476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669b05e74250480f9712be2a43d7eb48', 'request_id': 'req-d6993090-1fe2-4fef-83ff-eedcf98c70dc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:24.159609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669b05e74250480f9712be2a43d7eb48', 'request_id': 'req-d6993090-1fe2-4fef-83ff-eedcf98c70dc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:24.207469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] The token cache is being invalidate because project 669b05e74250480f9712be2a43d7eb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:24.208296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:24.209047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d6993090-1fe2-4fef-83ff-eedcf98c70dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:24.212081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1130/2251] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:23 2022] DELETE /identity/v3/projects/669b05e74250480f9712be2a43d7eb48 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:24.218670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e80403-eda5-4f33-aa16-6869f1d621ac None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.218960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e80403-eda5-4f33-aa16-6869f1d621ac None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.219284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e80403-eda5-4f33-aa16-6869f1d621ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.232519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:24.291726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-89e80403-eda5-4f33-aa16-6869f1d621ac None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:24.293693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-89e80403-eda5-4f33-aa16-6869f1d621ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:24.374470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1122/2252] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:24.382298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f97bc-731e-491d-b028-081f8e2ee991 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.382554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f97bc-731e-491d-b028-081f8e2ee991 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.382771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f97bc-731e-491d-b028-081f8e2ee991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.401458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fa7f97bc-731e-491d-b028-081f8e2ee991 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:24.402845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fa7f97bc-731e-491d-b028-081f8e2ee991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:24.411814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1131/2253] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:24.421632 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e80403-eda5-4f33-aa16-6869f1d621ac None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:24.432248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e80403-eda5-4f33-aa16-6869f1d621ac None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:24.437345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:24.437998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.438276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.438547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.439280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:07:24.439585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:24.441278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:24.453358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1123/2254] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:07:24.457653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f97bc-731e-491d-b028-081f8e2ee991 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:24.467996 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f97bc-731e-491d-b028-081f8e2ee991 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:24.473527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:24.474198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.474477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.474752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.475447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:24.477415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:24.509749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1132/2255] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:24 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:24.511834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:24.522977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ad415-f958-4580-a533-f4d0dd3bc401 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:24.597357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:24.598030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.598310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.598581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.599276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:24.601270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:24.622116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1124/2256] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:24 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:24.632067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:24.643490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4aea-b9b2-43a5-b148-2fc7c30bd1ef admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:24.649932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:24.650864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.651148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.651521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.652359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:24.654487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:24.667837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1133/2257] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:24.672861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:24.688250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767424-e5fd-4844-aa45-f7c2219e9e99 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:24.695030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca2b08-c8e8-4a61-8b5e-bba4481391d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:24.695995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca2b08-c8e8-4a61-8b5e-bba4481391d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.696455 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca2b08-c8e8-4a61-8b5e-bba4481391d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.696788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca2b08-c8e8-4a61-8b5e-bba4481391d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.697848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca2b08-c8e8-4a61-8b5e-bba4481391d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:24.699624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca2b08-c8e8-4a61-8b5e-bba4481391d5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:24.714431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1125/2258] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:24.718606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:24.731792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317879-6648-4f19-b449-aa29524e4760 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:24.737420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:24.738328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.738608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.738884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] PATH_INFO: `/v3/projects/f47e46f0edc84fca8d7e2c144d9c419a/users/78cef65af92c4050a65ee4ae0ef610e3/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.758592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47e46f0edc84fca8d7e2c144d9c419a, user_id=78cef65af92c4050a65ee4ae0ef610e3, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:24.761706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:24.787388 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1134/2259] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:24 2022] PUT /identity/v3/projects/f47e46f0edc84fca8d7e2c144d9c419a/users/78cef65af92c4050a65ee4ae0ef610e3/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:24.799165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20607c14-f1bc-4cfd-a231-25a534c3da75 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.799460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20607c14-f1bc-4cfd-a231-25a534c3da75 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.799726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20607c14-f1bc-4cfd-a231-25a534c3da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.828086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-20607c14-f1bc-4cfd-a231-25a534c3da75 None None] MFA Rules not processed for user `78cef65af92c4050a65ee4ae0ef610e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:24.829614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-20607c14-f1bc-4cfd-a231-25a534c3da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:24.884409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:24.925953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1126/2260] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:24.926963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.056885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670806e6-44da-4e7e-aca9-df17c29c41f5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.062555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.063310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.063945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.064288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.065094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.067350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.106139 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1135/2261] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:24 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:07:25.110875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20607c14-f1bc-4cfd-a231-25a534c3da75 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.122007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20607c14-f1bc-4cfd-a231-25a534c3da75 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.188287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.189626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.189626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.189626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.190511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.192535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.216937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1127/2262] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:25 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:25.222211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.235730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e23a5-a138-4091-981e-bcaaea34a7e8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.250233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.250958 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.251333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.251609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.252403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.254348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.268717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1136/2263] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:07:25.271106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.281244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470632-299c-41fd-aac5-b0ee32711040 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.285915 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.286797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.287073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.287341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] PATH_INFO: `/v3/projects/17526918a7b143ffbf6c45a5cede21bd/users/132a0e5fc53548549494ce21ca28a50b/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.312553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17526918a7b143ffbf6c45a5cede21bd, user_id=132a0e5fc53548549494ce21ca28a50b, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.315428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.333643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1128/2264] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:25 2022] PUT /identity/v3/projects/17526918a7b143ffbf6c45a5cede21bd/users/132a0e5fc53548549494ce21ca28a50b/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:07:25.335152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.346991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f71507-67b0-4760-9538-0b704489052a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.372097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:25.428553 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c56de8-8334-41aa-9875-83957ff83bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.429564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c56de8-8334-41aa-9875-83957ff83bef admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.429989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c56de8-8334-41aa-9875-83957ff83bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.430433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c56de8-8334-41aa-9875-83957ff83bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.431277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c56de8-8334-41aa-9875-83957ff83bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.437155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c56de8-8334-41aa-9875-83957ff83bef admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.467495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1137/2265] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:07:25.471979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.484793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5e75a-b1d1-4d4f-8960-f40617fe4a86 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.491302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.492207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.492479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.492784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] PATH_INFO: `/v3/projects/17526918a7b143ffbf6c45a5cede21bd/users/132a0e5fc53548549494ce21ca28a50b/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.495755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17526918a7b143ffbf6c45a5cede21bd, user_id=132a0e5fc53548549494ce21ca28a50b, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.501542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.514890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1129/2266] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:25 2022] PUT /identity/v3/projects/17526918a7b143ffbf6c45a5cede21bd/users/132a0e5fc53548549494ce21ca28a50b/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:25.525060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2857d-06d0-49bd-9ec9-4b025110cac9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.525419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2857d-06d0-49bd-9ec9-4b025110cac9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.525780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2857d-06d0-49bd-9ec9-4b025110cac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.553501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-87f2857d-06d0-49bd-9ec9-4b025110cac9 None None] MFA Rules not processed for user `132a0e5fc53548549494ce21ca28a50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:25.555004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-87f2857d-06d0-49bd-9ec9-4b025110cac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:25.629544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1138/2267] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:25.644749 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.646584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:25.709969 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0511-1d33-46c0-bc34-65cdb83c0ea6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.713974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf23bb1-2750-46a6-9549-5ff7ecbb6061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.714611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf23bb1-2750-46a6-9549-5ff7ecbb6061 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.714870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf23bb1-2750-46a6-9549-5ff7ecbb6061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.715156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf23bb1-2750-46a6-9549-5ff7ecbb6061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.724281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf23bb1-2750-46a6-9549-5ff7ecbb6061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.725741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf23bb1-2750-46a6-9549-5ff7ecbb6061 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.735118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1130/2268] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:25.762879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2857d-06d0-49bd-9ec9-4b025110cac9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.859898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2857d-06d0-49bd-9ec9-4b025110cac9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.864750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.865635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.865907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.866175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] PATH_INFO: `/v3/users/78cef65af92c4050a65ee4ae0ef610e3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.867504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78cef65af92c4050a65ee4ae0ef610e3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.869483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.913510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:25.922837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78cef65af92c4050a65ee4ae0ef610e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:25.923655 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78cef65af92c4050a65ee4ae0ef610e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:25.936604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78cef65af92c4050a65ee4ae0ef610e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:25.949938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78cef65af92c4050a65ee4ae0ef610e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:25.958109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78cef65af92c4050a65ee4ae0ef610e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:25.964801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1139/2269] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:25 2022] DELETE /identity/v3/users/78cef65af92c4050a65ee4ae0ef610e3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:25.969289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.969574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.969844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.988286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:25.989517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:26.030460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:26.071307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1131/2270] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:26.078245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:26.079765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:26.192313 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c348f9-885c-4f38-b55a-ae3a34da498c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:26.196706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:26.197466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:26.197843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:26.198145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:26.209889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:26.211329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:26.222176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1140/2271] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:26.798330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:26.799874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:26.814282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e7be8-7e8b-4bc9-b3dd-892f0498f9dd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:26.841309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:26.842325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:26.842604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:26.843409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] PATH_INFO: `/v3/projects/f47e46f0edc84fca8d7e2c144d9c419a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:26.853577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47e46f0edc84fca8d7e2c144d9c419a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:26.855527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:26.933596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47e46f0edc84fca8d7e2c144d9c419a', 'request_id': 'req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:26.939637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47e46f0edc84fca8d7e2c144d9c419a', 'request_id': 'req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:26.947758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47e46f0edc84fca8d7e2c144d9c419a', 'request_id': 'req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:26.961210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] The token cache is being invalidate because project f47e46f0edc84fca8d7e2c144d9c419a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:26.961491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:26.962104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:26.963657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1132/2272] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:26 2022] DELETE /identity/v3/projects/f47e46f0edc84fca8d7e2c144d9c419a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:26.968026 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:26.977835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ae6e5-abd6-4e88-a562-50b271288668 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:27.039008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:27.039878 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.040155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.040428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] PATH_INFO: `/v3/users/132a0e5fc53548549494ce21ca28a50b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.041685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132a0e5fc53548549494ce21ca28a50b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:27.043642 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:27.090252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132a0e5fc53548549494ce21ca28a50b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.090905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132a0e5fc53548549494ce21ca28a50b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.100217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132a0e5fc53548549494ce21ca28a50b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.108428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:27.116233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132a0e5fc53548549494ce21ca28a50b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.123384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bfbb80f1-17a1-40b8-86f4-d5d064562bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132a0e5fc53548549494ce21ca28a50b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.129921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1141/2273] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:26 2022] DELETE /identity/v3/users/132a0e5fc53548549494ce21ca28a50b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:27.437602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:27.441394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:27.459746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9686-d1d7-4a6c-9d3c-f9d280841aa1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:27.532039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:27.532953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.533231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.533505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] PATH_INFO: `/v3/projects/17526918a7b143ffbf6c45a5cede21bd` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.534732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17526918a7b143ffbf6c45a5cede21bd)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:27.536765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:27.590322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17526918a7b143ffbf6c45a5cede21bd', 'request_id': 'req-632ee456-d157-45a4-8fe4-bf61043e1be3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.597762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17526918a7b143ffbf6c45a5cede21bd', 'request_id': 'req-632ee456-d157-45a4-8fe4-bf61043e1be3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.606905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17526918a7b143ffbf6c45a5cede21bd', 'request_id': 'req-632ee456-d157-45a4-8fe4-bf61043e1be3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.610195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:27.623391 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] The token cache is being invalidate because project 17526918a7b143ffbf6c45a5cede21bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:27.623681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.624319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-632ee456-d157-45a4-8fe4-bf61043e1be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:27.625887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1133/2274] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:27 2022] DELETE /identity/v3/projects/17526918a7b143ffbf6c45a5cede21bd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:27.631049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47237d54-2cf0-4267-bf50-400e1e8b2752 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.631529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47237d54-2cf0-4267-bf50-400e1e8b2752 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.631694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47237d54-2cf0-4267-bf50-400e1e8b2752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.664610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-47237d54-2cf0-4267-bf50-400e1e8b2752 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:27.665885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-47237d54-2cf0-4267-bf50-400e1e8b2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:27.727241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1142/2275] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:27.735097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6478608-59d4-4499-9f87-734edd61006b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.735388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6478608-59d4-4499-9f87-734edd61006b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.735664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6478608-59d4-4499-9f87-734edd61006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.755194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f6478608-59d4-4499-9f87-734edd61006b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:27.756318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f6478608-59d4-4499-9f87-734edd61006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:27.765834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1134/2276] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:27.770328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47237d54-2cf0-4267-bf50-400e1e8b2752 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:27.780834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47237d54-2cf0-4267-bf50-400e1e8b2752 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:27.785949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:27.786610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.786890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.787134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.787893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:07:27.788206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:27.789860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:27.804082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1143/2277] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:07:27.808477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6478608-59d4-4499-9f87-734edd61006b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:27.820193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6478608-59d4-4499-9f87-734edd61006b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:27.826626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:27.827309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.827584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.827852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.828549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:27.830497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:27.865882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1135/2278] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:27 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:27.871169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:27.886919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41700c93-93e6-4a0a-816d-f3237a0d6a82 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:27.970780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:27.970986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.971152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.971402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.972164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:27.974094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:27.997418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1144/2279] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:27 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:28.001564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.015341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289df4c-a779-4ed3-8874-394bed3228fa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.020447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.021280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.021511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.021791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.022832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.024174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.035833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1136/2280] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:28.042070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.052585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d936c6-57eb-4050-b756-24d4b27df296 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.057408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd6284-0104-430d-b692-ead81d805c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.058097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6284-0104-430d-b692-ead81d805c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.058384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6284-0104-430d-b692-ead81d805c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.058656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6284-0104-430d-b692-ead81d805c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.059397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd6284-0104-430d-b692-ead81d805c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.061075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd6284-0104-430d-b692-ead81d805c47 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.072254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1145/2281] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:28.076463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.086973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf5eb7-21ae-4bcc-a262-98191b443778 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.092284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.093253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.093527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.093808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] PATH_INFO: `/v3/projects/1791dc683b304f4fb103694d7ee9382e/users/28d9df154a8b4552a2033e5e81509338/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.112466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1791dc683b304f4fb103694d7ee9382e, user_id=28d9df154a8b4552a2033e5e81509338, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.115188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.131396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1137/2282] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:28 2022] PUT /identity/v3/projects/1791dc683b304f4fb103694d7ee9382e/users/28d9df154a8b4552a2033e5e81509338/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:28.143991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ec46-a4d0-4495-b40d-58567df46d36 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.143991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ec46-a4d0-4495-b40d-58567df46d36 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.144769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ec46-a4d0-4495-b40d-58567df46d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.182262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d596ec46-a4d0-4495-b40d-58567df46d36 None None] MFA Rules not processed for user `28d9df154a8b4552a2033e5e81509338`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:28.183658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d596ec46-a4d0-4495-b40d-58567df46d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:28.214513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:28.261675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1146/2283] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:28.266042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.363556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381281a-78b4-4716-8235-0fc2e6990df7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.368138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.368830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.369109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.369375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.370100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.371993 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.400580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1138/2284] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:28 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:28.404493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596ec46-a4d0-4495-b40d-58567df46d36 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.415519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596ec46-a4d0-4495-b40d-58567df46d36 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.477311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.477988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.478268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.478536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.479232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.481255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.507057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1147/2285] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:28 2022] POST /identity/v3/users => generated 307 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:28.508170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.521102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7fcfb-aaf8-44f4-8b7e-0517aba3762b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.526472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.527144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.527425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.527696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.528503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.530453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.541619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1139/2286] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:28.546778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.558038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6aa35-d940-45bb-b868-a8719ac5bc4e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.563058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.563970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.564254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.564551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] PATH_INFO: `/v3/projects/b775b50b5ddb456eb2caf9aad208a0c9/users/e22ed732bf47491eb6de722552573540/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.590797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b775b50b5ddb456eb2caf9aad208a0c9, user_id=e22ed732bf47491eb6de722552573540, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.590797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.606063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1148/2287] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:28 2022] PUT /identity/v3/projects/b775b50b5ddb456eb2caf9aad208a0c9/users/e22ed732bf47491eb6de722552573540/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:28.610074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.620208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2582be-3948-4fa4-ab71-3bb1b54b1aec admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.677267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc334a-b4b8-45d5-a24d-614b638559d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.677968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc334a-b4b8-45d5-a24d-614b638559d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.678241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc334a-b4b8-45d5-a24d-614b638559d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.678515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc334a-b4b8-45d5-a24d-614b638559d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.679236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc334a-b4b8-45d5-a24d-614b638559d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.680907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc334a-b4b8-45d5-a24d-614b638559d7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.687914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:28.691842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1140/2288] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:28.696371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.707665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc023-8539-4d5c-b1c5-6a7a60b636ba admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.714422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.715346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.715649 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.715919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] PATH_INFO: `/v3/projects/b775b50b5ddb456eb2caf9aad208a0c9/users/e22ed732bf47491eb6de722552573540/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.718205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b775b50b5ddb456eb2caf9aad208a0c9, user_id=e22ed732bf47491eb6de722552573540, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.721004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.733171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1149/2289] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:28 2022] PUT /identity/v3/projects/b775b50b5ddb456eb2caf9aad208a0c9/users/e22ed732bf47491eb6de722552573540/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:28.743514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.743908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.744246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.771981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] MFA Rules not processed for user `e22ed732bf47491eb6de722552573540`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:28.773142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:28.849166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1141/2290] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:28.864174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:28.866075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:28.926468 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9ecf4-80f7-4ee3-85f7-c1821513c8b0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:28.930076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:28.930724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:28.931023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:28.931291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:28.948125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:28.949639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:28.960451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1150/2291] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:29.049728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:29.051781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:29.064756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c262a7-09f4-4b94-a583-a19e67b21107 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:29.068458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c6baf-21a4-4931-b27b-9860a012ce2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:29.071106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6baf-21a4-4931-b27b-9860a012ce2c service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:29.071106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6baf-21a4-4931-b27b-9860a012ce2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:29.071106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6baf-21a4-4931-b27b-9860a012ce2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:29.147175 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c6baf-21a4-4931-b27b-9860a012ce2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:29.148875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c6baf-21a4-4931-b27b-9860a012ce2c service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:29.160133 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1142/2292] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:33.366618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:33.394226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:33.436431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9337-2896-447c-b607-b36cc8dc3313 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:33.441392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:33.442270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:33.442546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:33.442813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] PATH_INFO: `/v3/users/28d9df154a8b4552a2033e5e81509338` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:33.444121 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d9df154a8b4552a2033e5e81509338)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:33.446116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:33.506108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d9df154a8b4552a2033e5e81509338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:33.506967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d9df154a8b4552a2033e5e81509338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:33.517007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d9df154a8b4552a2033e5e81509338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:33.536256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d9df154a8b4552a2033e5e81509338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:33.548467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d9df154a8b4552a2033e5e81509338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:33.556151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1151/2293] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:33 2022] DELETE /identity/v3/users/28d9df154a8b4552a2033e5e81509338 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:33.560607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f78-e2d5-4811-bb90-bd919263c11a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:33.561128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f78-e2d5-4811-bb90-bd919263c11a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:33.561230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f78-e2d5-4811-bb90-bd919263c11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:33.580401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-74435f78-e2d5-4811-bb90-bd919263c11a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:33.581755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-74435f78-e2d5-4811-bb90-bd919263c11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:33.656176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1143/2294] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:33.666518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:33.667921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:33.734622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a64e2-a1f2-481f-8b79-3794f81a68c7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:33.738896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:33.739571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:33.739907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:33.740152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:33.761786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:33.763262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:33.775143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1152/2295] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:07:33.922869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:33.922869 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:33.923144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:33.964937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:33.966221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:33.981673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:34.049358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1144/2296] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:34.094733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:34.097748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:34.168493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:34.197836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd363d-3424-4d48-9ef8-ab8a912598fb service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:34.213778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:34.214461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:34.214735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:34.215002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:34.225113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:34.226885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:34.237768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:34.239180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:34.254538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1153/2297] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 12:07:34.261252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3b7dd-65a1-41af-ac1e-f7f22b49e557 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:34.293395 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:34.295263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:34.295703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:34.295889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] PATH_INFO: `/v3/projects/1791dc683b304f4fb103694d7ee9382e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:34.297682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1791dc683b304f4fb103694d7ee9382e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:34.299891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:34.365127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1791dc683b304f4fb103694d7ee9382e', 'request_id': 'req-b8a104c6-05e2-42d3-b163-f18950032ab7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.370861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1791dc683b304f4fb103694d7ee9382e', 'request_id': 'req-b8a104c6-05e2-42d3-b163-f18950032ab7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.377466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1791dc683b304f4fb103694d7ee9382e', 'request_id': 'req-b8a104c6-05e2-42d3-b163-f18950032ab7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.392321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] The token cache is being invalidate because project 1791dc683b304f4fb103694d7ee9382e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:34.392668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.393313 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b8a104c6-05e2-42d3-b163-f18950032ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.395132 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1145/2298] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:34 2022] DELETE /identity/v3/projects/1791dc683b304f4fb103694d7ee9382e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:34.400460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:34.413092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29d920-2aac-4b9f-b0f8-a74cd27df5be service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:34.475992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:34.476906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:34.477184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:34.477452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] PATH_INFO: `/v3/users/e22ed732bf47491eb6de722552573540` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:34.478659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22ed732bf47491eb6de722552573540)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:34.480662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:34.535987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22ed732bf47491eb6de722552573540'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.536852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22ed732bf47491eb6de722552573540'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.547803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22ed732bf47491eb6de722552573540'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.560601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22ed732bf47491eb6de722552573540'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.568202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22ed732bf47491eb6de722552573540'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:34.574215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1154/2299] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:34 2022] DELETE /identity/v3/users/e22ed732bf47491eb6de722552573540 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:07:34.851516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:34.852709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:34.853303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:34.870673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:34.872473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:34.887305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:34.888808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:34.952187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1146/2300] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 12:07:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:34.953083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:34.967473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:34.969075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:34.969769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d7349-c80a-4845-8e5f-6fc9d0f2548d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:34.977297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:34.978218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:34.978495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:34.978764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] PATH_INFO: `/v3/projects/b775b50b5ddb456eb2caf9aad208a0c9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:34.979954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b775b50b5ddb456eb2caf9aad208a0c9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:34.981959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.024838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:35.042918 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b775b50b5ddb456eb2caf9aad208a0c9', 'request_id': 'req-69e559de-5635-4407-a514-08bbe4efd570'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:35.049472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b775b50b5ddb456eb2caf9aad208a0c9', 'request_id': 'req-69e559de-5635-4407-a514-08bbe4efd570'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:35.056271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b775b50b5ddb456eb2caf9aad208a0c9', 'request_id': 'req-69e559de-5635-4407-a514-08bbe4efd570'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:35.073018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011e12-1eda-4264-a702-f8c00716d5ec None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.073284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] The token cache is being invalidate because project b775b50b5ddb456eb2caf9aad208a0c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:35.074237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:35.074733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-69e559de-5635-4407-a514-08bbe4efd570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:35.081210 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1155/2301] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:34 2022] DELETE /identity/v3/projects/b775b50b5ddb456eb2caf9aad208a0c9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:35.086998 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06b85c-9474-4312-bdad-379cdd2915c4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.087583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06b85c-9474-4312-bdad-379cdd2915c4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.088009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06b85c-9474-4312-bdad-379cdd2915c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.124455 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fa06b85c-9474-4312-bdad-379cdd2915c4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:35.125769 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fa06b85c-9474-4312-bdad-379cdd2915c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:35.172727 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.173470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.173866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.174319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.177895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:35.201902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1156/2302] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:35.214621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc7ea-fd56-402a-9e08-4342f5bdb23c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.214909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc7ea-fd56-402a-9e08-4342f5bdb23c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.215188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc7ea-fd56-402a-9e08-4342f5bdb23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.257982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-41dfc7ea-fd56-402a-9e08-4342f5bdb23c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:35.259215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41dfc7ea-fd56-402a-9e08-4342f5bdb23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:35.266787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.268242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1157/2303] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:35.272766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.272971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc7ea-fd56-402a-9e08-4342f5bdb23c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.283696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1147/2304] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 12:07:35.286073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc7ea-fd56-402a-9e08-4342f5bdb23c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.292832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.293633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.294071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.294806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.295624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:07:35.295864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.303165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.325860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.355869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1158/2305] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:07:35.358209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f8f99-73c5-4857-bd5c-5bd734b9894b service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.378678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.380211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.381565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.382116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.382885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.385284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.432122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1148/2306] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:35 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:35.436960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.452971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94ca1-ee84-417f-be78-ed3d325c4fc5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.559182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951defb4-6a69-4bf2-bc1d-57954e27bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.561247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951defb4-6a69-4bf2-bc1d-57954e27bd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.561546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951defb4-6a69-4bf2-bc1d-57954e27bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.561956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951defb4-6a69-4bf2-bc1d-57954e27bd9a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.563123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951defb4-6a69-4bf2-bc1d-57954e27bd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.565829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951defb4-6a69-4bf2-bc1d-57954e27bd9a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.578884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:35.596564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1159/2307] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:35 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:35.600379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.611772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9893b-5855-4bbe-aabe-824521351c27 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.614901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089851ff-3e93-4160-a867-915480607d9d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.615191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089851ff-3e93-4160-a867-915480607d9d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.615465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089851ff-3e93-4160-a867-915480607d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.616552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.617302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.617560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.617841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.618573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.620212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.631476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1149/2308] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:35.633229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-089851ff-3e93-4160-a867-915480607d9d None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:35.634776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-089851ff-3e93-4160-a867-915480607d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:35.635516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.645757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ae19-4bbb-49a9-ad79-c158d6c19c1f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.650458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.651127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.651403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.651668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.652586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.653992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.667443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1150/2309] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:07:35.668884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.678877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7c8b-5e11-4f45-8955-6d6ae1a81816 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.683356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedebd88-e57d-41a9-bf25-9c6f18d645da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.684226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebd88-e57d-41a9-bf25-9c6f18d645da admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.684504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebd88-e57d-41a9-bf25-9c6f18d645da admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.684825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebd88-e57d-41a9-bf25-9c6f18d645da admin admin] PATH_INFO: `/v3/projects/d1f144505a1b489bb72b24fa9c91851e/users/2616b67bbf5a44d5997fc4d91a00004b/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.699386 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedebd88-e57d-41a9-bf25-9c6f18d645da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f144505a1b489bb72b24fa9c91851e, user_id=2616b67bbf5a44d5997fc4d91a00004b, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.699851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1160/2310] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:35.702320 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedebd88-e57d-41a9-bf25-9c6f18d645da admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.712519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089851ff-3e93-4160-a867-915480607d9d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.713974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-089851ff-3e93-4160-a867-915480607d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:35.720837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1151/2311] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:35 2022] PUT /identity/v3/projects/d1f144505a1b489bb72b24fa9c91851e/users/2616b67bbf5a44d5997fc4d91a00004b/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:35.731277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.731828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.732841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.764894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] MFA Rules not processed for user `2616b67bbf5a44d5997fc4d91a00004b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:35.766765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:35.779686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:35.793792 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089851ff-3e93-4160-a867-915480607d9d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.842734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1152/2312] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:35.853896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:35.855392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:35.873665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee0710-82dc-4d84-9516-b5f56c54015d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.874318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee0710-82dc-4d84-9516-b5f56c54015d service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.874599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee0710-82dc-4d84-9516-b5f56c54015d service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.874872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee0710-82dc-4d84-9516-b5f56c54015d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.912489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:35.913203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357cbd8-841f-4335-a5d6-7f99976089db None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:35.917575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:35.918271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:35.918492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:35.919621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:35.931390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.931390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.942752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1153/2313] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:07:35.944295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee0710-82dc-4d84-9516-b5f56c54015d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:35.945966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee0710-82dc-4d84-9516-b5f56c54015d service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:35.955072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1161/2314] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:07:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:07:35.967792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:36.045375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff72a0-6872-495f-80f6-6c042619a5fa service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:36.049859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:36.050806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.051076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.051341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] PATH_INFO: `/v3/users/2616b67bbf5a44d5997fc4d91a00004b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:36.052564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2616b67bbf5a44d5997fc4d91a00004b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:36.054510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:36.106117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2616b67bbf5a44d5997fc4d91a00004b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.106841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2616b67bbf5a44d5997fc4d91a00004b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.107789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2616b67bbf5a44d5997fc4d91a00004b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.116289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2616b67bbf5a44d5997fc4d91a00004b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.121230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:36.136396 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2616b67bbf5a44d5997fc4d91a00004b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.149960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1154/2315] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:35 2022] DELETE /identity/v3/users/2616b67bbf5a44d5997fc4d91a00004b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:36.155113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690f363-19ce-43cc-9f42-3d147f4bc805 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.155401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690f363-19ce-43cc-9f42-3d147f4bc805 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.155672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690f363-19ce-43cc-9f42-3d147f4bc805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:36.174104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3690f363-19ce-43cc-9f42-3d147f4bc805 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:36.175460 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3690f363-19ce-43cc-9f42-3d147f4bc805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:36.244771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1162/2316] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:36.255109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:36.256750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:36.325263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a370b8-6700-4c2f-a94e-f66f9c641182 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:36.329184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:36.329841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.330161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.330782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:36.339442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.339778 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.340275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:36.341521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:36.342994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:36.353271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1155/2317] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:36.359395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:36.360816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:36.439376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1163/2318] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:36.444544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:36.446017 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:36.543117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7218635-27cb-45b6-a811-85fd9e4cf69d service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:36.548846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537865c-c4ab-473d-af5c-a81827ffbb6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:36.551715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537865c-c4ab-473d-af5c-a81827ffbb6d service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.552015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537865c-c4ab-473d-af5c-a81827ffbb6d service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.552272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537865c-c4ab-473d-af5c-a81827ffbb6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:36.565032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537865c-c4ab-473d-af5c-a81827ffbb6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:36.566657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537865c-c4ab-473d-af5c-a81827ffbb6d service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:36.575431 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1156/2319] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:07:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:07:36.754355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:36.755828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:36.789347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3814c-471b-4f96-81d6-6f1b1346ac72 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:36.795672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:36.796571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.797012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.797343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] PATH_INFO: `/v3/projects/d1f144505a1b489bb72b24fa9c91851e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:36.798810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f144505a1b489bb72b24fa9c91851e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:36.802581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:36.868145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f144505a1b489bb72b24fa9c91851e', 'request_id': 'req-642485ca-fbc8-4751-8314-14ef7bfa935d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.874030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f144505a1b489bb72b24fa9c91851e', 'request_id': 'req-642485ca-fbc8-4751-8314-14ef7bfa935d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.880857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f144505a1b489bb72b24fa9c91851e', 'request_id': 'req-642485ca-fbc8-4751-8314-14ef7bfa935d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.896609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] The token cache is being invalidate because project d1f144505a1b489bb72b24fa9c91851e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:36.896926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.897791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-642485ca-fbc8-4751-8314-14ef7bfa935d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:36.899390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1164/2320] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:36 2022] DELETE /identity/v3/projects/d1f144505a1b489bb72b24fa9c91851e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:36.906286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959041-65a2-4662-969b-07c8da9d9dc8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.906777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959041-65a2-4662-969b-07c8da9d9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.907195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959041-65a2-4662-969b-07c8da9d9dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:36.926513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d6959041-65a2-4662-969b-07c8da9d9dc8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:36.927738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d6959041-65a2-4662-969b-07c8da9d9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:36.988689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1157/2321] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:36.996454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cba11-a96e-47ef-8907-97cf19fcae0d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:36.996851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cba11-a96e-47ef-8907-97cf19fcae0d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:36.997197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cba11-a96e-47ef-8907-97cf19fcae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.005222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:37.027010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7c7cba11-a96e-47ef-8907-97cf19fcae0d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:37.027010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c7cba11-a96e-47ef-8907-97cf19fcae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:37.028051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1165/2322] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:37.032278 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6959041-65a2-4662-969b-07c8da9d9dc8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:37.043271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6959041-65a2-4662-969b-07c8da9d9dc8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:37.048827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:37.049498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.049776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.050084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.050826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:07:37.051129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:37.052779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:37.055602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:37.079326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1158/2323] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:07:37.083907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cba11-a96e-47ef-8907-97cf19fcae0d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:37.093377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cba11-a96e-47ef-8907-97cf19fcae0d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:37.098106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:37.098758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.099034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.099302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.099991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:37.101947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:37.134981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1166/2324] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:37 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:37.136400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:37.147303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf75472-a11d-4341-bdff-d2393bc26996 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:37.239565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:37.240376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.240678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.240949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.241668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:37.243624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:37.273726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1159/2325] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:37 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:07:37.277620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:37.288578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990126-4359-464b-a3e2-e1735e896b9d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:37.293834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:37.294583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.294931 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.295270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.296556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:37.298491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:37.311134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1167/2326] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:37.315117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:37.326707 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48c18-4471-42e7-89a9-ab76327b40c3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:37.332308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7667a8-a422-4e5b-b2d3-62ad0c400c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:37.333094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7667a8-a422-4e5b-b2d3-62ad0c400c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.333378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7667a8-a422-4e5b-b2d3-62ad0c400c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.333688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7667a8-a422-4e5b-b2d3-62ad0c400c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.334385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7667a8-a422-4e5b-b2d3-62ad0c400c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:37.339345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7667a8-a422-4e5b-b2d3-62ad0c400c82 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:37.350781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1160/2327] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:37.355204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:37.365968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2cb9-19d6-4bbf-b127-d5667b93fdcb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:37.371703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:37.373316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.373608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.373880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] PATH_INFO: `/v3/projects/53b90c10b99d47a482dc7cf04a89891b/users/b6d390c531b845ed8d489e1fe52dd3e8/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.396418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b90c10b99d47a482dc7cf04a89891b, user_id=b6d390c531b845ed8d489e1fe52dd3e8, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:37.401646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:37.424742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1168/2328] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:37 2022] PUT /identity/v3/projects/53b90c10b99d47a482dc7cf04a89891b/users/b6d390c531b845ed8d489e1fe52dd3e8/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:07:37.432730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.433096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.433310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.481709 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] MFA Rules not processed for user `b6d390c531b845ed8d489e1fe52dd3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:37.483103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:37.558556 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1161/2329] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:37.570128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:37.575562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:37.638770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6104-cf93-4327-aafa-d7fe8f040c00 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:37.642441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233d33-a1ec-4b7f-9206-57a7e4d223b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1470011d984f45be788072525f82cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:37.643088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233d33-a1ec-4b7f-9206-57a7e4d223b2 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:37.643366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233d33-a1ec-4b7f-9206-57a7e4d223b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:37.643637 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233d33-a1ec-4b7f-9206-57a7e4d223b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:37.653902 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233d33-a1ec-4b7f-9206-57a7e4d223b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:37.657281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233d33-a1ec-4b7f-9206-57a7e4d223b2 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:37.666754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1169/2330] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:38.798256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:38.799874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:38.871834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ae3c2-bc5b-4a01-9c8b-9f70fcc6a34c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:38.877310 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:38.878177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:38.878576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:38.878938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] PATH_INFO: `/v3/users/3ec3996d0f6049b5afbe3b58eb232225` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:38.880309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec3996d0f6049b5afbe3b58eb232225)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:38.882372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:38.887817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:38.946005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec3996d0f6049b5afbe3b58eb232225'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:38.946878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec3996d0f6049b5afbe3b58eb232225'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:38.948149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec3996d0f6049b5afbe3b58eb232225'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:38.971595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec3996d0f6049b5afbe3b58eb232225'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:38.990216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec3996d0f6049b5afbe3b58eb232225'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:39.010281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1162/2331] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:38 2022] DELETE /identity/v3/users/3ec3996d0f6049b5afbe3b58eb232225 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:39.014849 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.015444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.015444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.033883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:39.035250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:39.101224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1170/2332] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:39.111243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.112874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:39.189698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659641b-97a5-473c-b9ea-b7c80cf27e83 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.205927 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a7710-efed-4380-9b98-26e7f3150f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.206646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7710-efed-4380-9b98-26e7f3150f0c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.206925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7710-efed-4380-9b98-26e7f3150f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.207195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7710-efed-4380-9b98-26e7f3150f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.224920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a7710-efed-4380-9b98-26e7f3150f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.224920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a7710-efed-4380-9b98-26e7f3150f0c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:39.236123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1163/2333] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:39.419742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.421294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:39.434845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb4e47-8b89-439f-bfa6-43d5e3b757bb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.440825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.441905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.442658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.442658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] PATH_INFO: `/v3/projects/99c5725383e84ebea4a4aaed91598a18` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.443951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c5725383e84ebea4a4aaed91598a18)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.446458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:39.489548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:39.506985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c5725383e84ebea4a4aaed91598a18', 'request_id': 'req-e733e8a9-4fc4-441a-94bf-6aff59855af6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:39.514253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c5725383e84ebea4a4aaed91598a18', 'request_id': 'req-e733e8a9-4fc4-441a-94bf-6aff59855af6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:39.524810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c5725383e84ebea4a4aaed91598a18', 'request_id': 'req-e733e8a9-4fc4-441a-94bf-6aff59855af6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:39.539694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] The token cache is being invalidate because project 99c5725383e84ebea4a4aaed91598a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:39.539982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:39.540604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e733e8a9-4fc4-441a-94bf-6aff59855af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:39.542209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1171/2334] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:39 2022] DELETE /identity/v3/projects/99c5725383e84ebea4a4aaed91598a18 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:39.547238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb9e6-d4df-47b6-834a-3d047eb69f26 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.547594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb9e6-d4df-47b6-834a-3d047eb69f26 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.547944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb9e6-d4df-47b6-834a-3d047eb69f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.566092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-127fb9e6-d4df-47b6-834a-3d047eb69f26 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:39.567253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-127fb9e6-d4df-47b6-834a-3d047eb69f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:39.650131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1164/2335] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:39.657836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2cd1-f96f-40f9-9b23-368e023c59af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.658203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2cd1-f96f-40f9-9b23-368e023c59af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.658481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2cd1-f96f-40f9-9b23-368e023c59af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.677226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-169f2cd1-f96f-40f9-9b23-368e023c59af None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:39.678434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-169f2cd1-f96f-40f9-9b23-368e023c59af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:39.686437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1172/2336] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:39.690451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb9e6-d4df-47b6-834a-3d047eb69f26 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.700576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb9e6-d4df-47b6-834a-3d047eb69f26 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.706353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.707041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.707316 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.707581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.708308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:07:39.708607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.710240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:39.723222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1165/2337] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:07:39.727718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2cd1-f96f-40f9-9b23-368e023c59af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.738057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2cd1-f96f-40f9-9b23-368e023c59af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.744084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.744781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.745063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.745363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.746171 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.748106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:39.779646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1173/2338] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:07:39 2022] POST /identity/v3/projects => generated 395 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:39.784058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.795354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f2a43-a989-43b6-9528-f57eb62bdd2e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.806583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:39.857874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.858546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.858819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.859086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.859776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.861740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:39.887193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1166/2339] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:07:39 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:07:39.888430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.900051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5afe8-b0cb-4819-860a-724b64f5a98c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.906010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.906709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.907031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.907256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.908017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.909722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:39.921973 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1174/2340] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:39.926117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.936294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6ec68-df2c-40e4-8203-042c7653b257 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.941290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087e12d-3302-4d9d-93c8-82ce7213bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.942023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087e12d-3302-4d9d-93c8-82ce7213bb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.942307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087e12d-3302-4d9d-93c8-82ce7213bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.942579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087e12d-3302-4d9d-93c8-82ce7213bb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.943344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087e12d-3302-4d9d-93c8-82ce7213bb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.944990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087e12d-3302-4d9d-93c8-82ce7213bb19 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:39.958662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1167/2341] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:07:39.959938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:39.970469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a215a-9c2d-4f77-8f2a-f6756f1a7bf5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:39.975419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:39.976311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:39.976622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:39.976949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] PATH_INFO: `/v3/projects/b543d00cb94744239138e53560324122/users/f3061cda13cc4a4b98a3702b0826ddd9/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:39.993339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b543d00cb94744239138e53560324122, user_id=f3061cda13cc4a4b98a3702b0826ddd9, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:39.996576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:40.013153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1175/2342] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:07:39 2022] PUT /identity/v3/projects/b543d00cb94744239138e53560324122/users/f3061cda13cc4a4b98a3702b0826ddd9/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:07:40.084994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:40.085309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:40.085568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:40.113370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] MFA Rules not processed for user `f3061cda13cc4a4b98a3702b0826ddd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:40.114647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:40.188214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1168/2343] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:40.200067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:40.201865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:40.291646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e42a38-c218-4cc2-b87f-e785e60ef65a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:40.296860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fb95f-6341-4f86-801e-e5171c62e3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:40.297825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb95f-6341-4f86-801e-e5171c62e3ae service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:40.298138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb95f-6341-4f86-801e-e5171c62e3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:40.298627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb95f-6341-4f86-801e-e5171c62e3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:40.312237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fb95f-6341-4f86-801e-e5171c62e3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:40.314056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fb95f-6341-4f86-801e-e5171c62e3ae service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:40.323689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1176/2344] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:41.682937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:41.684447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:41.747532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874c490-d809-4bc9-b9f7-b7a05f022340 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:41.751142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:41.751781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:41.752053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:41.752318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:41.754276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:41.792518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:41.827266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:41.828745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:41.852109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1169/2345] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:42.448483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090c9c-8d57-4ef0-bc1a-c660b43d662e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:42.449030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090c9c-8d57-4ef0-bc1a-c660b43d662e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:42.449129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090c9c-8d57-4ef0-bc1a-c660b43d662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:42.468306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-66090c9c-8d57-4ef0-bc1a-c660b43d662e None None] MFA Rules not processed for user `19ccb0e5ef064cfda61c913034da54a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:42.469569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66090c9c-8d57-4ef0-bc1a-c660b43d662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:42.540084 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1177/2346] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:48.466378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:48.600898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8645dbe-ed4c-493b-a834-45948d05daff service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:48.605696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:48.606586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:48.606862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:48.607140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] PATH_INFO: `/v3/users/f3061cda13cc4a4b98a3702b0826ddd9` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:48.608332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3061cda13cc4a4b98a3702b0826ddd9)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:48.610265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:48.663365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3061cda13cc4a4b98a3702b0826ddd9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:48.664137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3061cda13cc4a4b98a3702b0826ddd9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:48.664971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3061cda13cc4a4b98a3702b0826ddd9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:48.679220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3061cda13cc4a4b98a3702b0826ddd9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:48.692484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3061cda13cc4a4b98a3702b0826ddd9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:48.710474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1170/2347] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:07:48 2022] DELETE /identity/v3/users/f3061cda13cc4a4b98a3702b0826ddd9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:07:48.712822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:48.714381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:48.714853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:48.740070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:48.741541 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:48.747964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:48.825670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1178/2348] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:48.837733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:48.839398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:48.902526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb686de-a2be-43b9-908d-4d4cf9c7e81c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:48.906329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001505b-1685-487f-819f-fa4caa2528f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:48.907064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001505b-1685-487f-819f-fa4caa2528f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:48.907329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001505b-1685-487f-819f-fa4caa2528f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:48.907614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001505b-1685-487f-819f-fa4caa2528f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:48.914104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:48.919542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001505b-1685-487f-819f-fa4caa2528f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:48.921027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001505b-1685-487f-819f-fa4caa2528f2 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:48.936528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1171/2349] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:49.258484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:49.260985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:49.278020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f3ee-c3b9-4dc2-aced-0e7b33200923 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:49.284457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:49.285403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:49.286757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:49.287116 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] PATH_INFO: `/v3/projects/b543d00cb94744239138e53560324122` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:49.289365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b543d00cb94744239138e53560324122)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:49.292189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:49.353491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b543d00cb94744239138e53560324122', 'request_id': 'req-0c80039f-2b14-410c-9070-6d133f829ec8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:49.362898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b543d00cb94744239138e53560324122', 'request_id': 'req-0c80039f-2b14-410c-9070-6d133f829ec8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:49.371777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b543d00cb94744239138e53560324122', 'request_id': 'req-0c80039f-2b14-410c-9070-6d133f829ec8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:49.390077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] The token cache is being invalidate because project b543d00cb94744239138e53560324122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:07:49.390397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:49.391135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:07:49.393375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1179/2350] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:07:49 2022] DELETE /identity/v3/projects/b543d00cb94744239138e53560324122 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:07:50.983243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629093-221d-49b5-b826-15050646b61c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:50.983794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629093-221d-49b5-b826-15050646b61c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:50.983890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629093-221d-49b5-b826-15050646b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:51.001987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3b629093-221d-49b5-b826-15050646b61c None None] MFA Rules not processed for user `36415049be5d4238a0275db21a8f378a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:51.003197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3b629093-221d-49b5-b826-15050646b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:51.069753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1172/2351] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:59.386130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:01.061052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=28 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:12.441874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:12.444046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:12.506652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80039f-2b14-410c-9070-6d133f829ec8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:12.510971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:12.511616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:12.511891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:12.512157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:12.514155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:12.580080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:12.581629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:12.591414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1180/2352] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:08:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:08:22.587581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=50 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:26.730852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:26.731380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:26.731673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:26.787983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:26.789329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:26.858433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1173/2353] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:26.873058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:26.874549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:26.972752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd840a-70a6-4855-bee2-ac6c4e1027cf service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:26.978030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:26.978680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:26.978957 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:26.979230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:26.988312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:26.989939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:26.998483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1181/2354] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:08:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:08:30.963951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:30.966784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:31.084460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69af69-2561-4d4a-ad98-6719d0df75a2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:31.090800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b40e6b-330b-499b-9fa6-6d048f31ed5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:31.091557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b40e6b-330b-499b-9fa6-6d048f31ed5c service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:31.091836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b40e6b-330b-499b-9fa6-6d048f31ed5c service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:31.092107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b40e6b-330b-499b-9fa6-6d048f31ed5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:31.093945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c7b40e6b-330b-499b-9fa6-6d048f31ed5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:31.112546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b40e6b-330b-499b-9fa6-6d048f31ed5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:31.115761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b40e6b-330b-499b-9fa6-6d048f31ed5c service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:31.132826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1174/2355] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:08:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:08:35.687528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:35.689137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:35.764333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11d203-f372-42c7-83e4-6522e7704b47 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:35.768409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:35.769320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:35.769603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:35.770107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] PATH_INFO: `/v3/users/b6d390c531b845ed8d489e1fe52dd3e8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:35.771336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d390c531b845ed8d489e1fe52dd3e8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:35.773340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:35.830135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d390c531b845ed8d489e1fe52dd3e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:35.830798 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d390c531b845ed8d489e1fe52dd3e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:35.840841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d390c531b845ed8d489e1fe52dd3e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:35.858041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d390c531b845ed8d489e1fe52dd3e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:35.859459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:35.869049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d390c531b845ed8d489e1fe52dd3e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:35.876588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1182/2356] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:08:35 2022] DELETE /identity/v3/users/b6d390c531b845ed8d489e1fe52dd3e8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:08:35.881567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:35.882089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:35.882291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:35.903782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:35.905138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:35.950790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:35.977545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1175/2357] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:35.989527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:35.991295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:36.065103 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae951b3-58db-4e24-84de-96a5115b6e69 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.069163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b62999-f72a-46be-8268-e81ae1241f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.069882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62999-f72a-46be-8268-e81ae1241f5d service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.070248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62999-f72a-46be-8268-e81ae1241f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.070578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62999-f72a-46be-8268-e81ae1241f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.080791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b62999-f72a-46be-8268-e81ae1241f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.082281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b62999-f72a-46be-8268-e81ae1241f5d service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.092582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1183/2358] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:08:36.408669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:36.410143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:36.425352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd92f0a-1384-4f1b-90b0-f180034d53ab None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.430029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.430960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.431369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.431649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] PATH_INFO: `/v3/projects/53b90c10b99d47a482dc7cf04a89891b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.433917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b90c10b99d47a482dc7cf04a89891b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.435875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.485212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b90c10b99d47a482dc7cf04a89891b', 'request_id': 'req-78c3dc81-c3f4-40c5-b38d-0ed17a172122'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:36.491051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b90c10b99d47a482dc7cf04a89891b', 'request_id': 'req-78c3dc81-c3f4-40c5-b38d-0ed17a172122'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:36.497626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b90c10b99d47a482dc7cf04a89891b', 'request_id': 'req-78c3dc81-c3f4-40c5-b38d-0ed17a172122'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:36.517136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] The token cache is being invalidate because project 53b90c10b99d47a482dc7cf04a89891b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:08:36.517423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:36.518128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78c3dc81-c3f4-40c5-b38d-0ed17a172122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:08:36.519814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1176/2359] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:08:36 2022] DELETE /identity/v3/projects/53b90c10b99d47a482dc7cf04a89891b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:08:36.524861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7b02-1037-423f-a946-6ebf767a14fa None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.525165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7b02-1037-423f-a946-6ebf767a14fa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.525440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7b02-1037-423f-a946-6ebf767a14fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.545652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-53ed7b02-1037-423f-a946-6ebf767a14fa None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:36.546854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-53ed7b02-1037-423f-a946-6ebf767a14fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:36.608147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1184/2360] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:36.616157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20388e-26cd-439c-a115-d121d56c4f96 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.616956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20388e-26cd-439c-a115-d121d56c4f96 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.617228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20388e-26cd-439c-a115-d121d56c4f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.637557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fb20388e-26cd-439c-a115-d121d56c4f96 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:36.638878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fb20388e-26cd-439c-a115-d121d56c4f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:36.648660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1177/2361] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:36.653054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7b02-1037-423f-a946-6ebf767a14fa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:36.662950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7b02-1037-423f-a946-6ebf767a14fa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.667567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.668229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.668508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.668808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.669583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:08:36.669885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.671548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.685667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1185/2362] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:08:36.690335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20388e-26cd-439c-a115-d121d56c4f96 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:36.699916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20388e-26cd-439c-a115-d121d56c4f96 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.705226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.705889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.706166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.706555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.707134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.709078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.736734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1178/2363] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:08:36 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:08:36.740975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:36.751375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193ab3-d699-485e-a1a1-50edc0f9f145 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.809757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.810428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.810708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.810979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.811686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.813669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.835447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1186/2364] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:08:36 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:08:36.839797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:36.850219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93f35e-89a9-4377-8688-a1b943edd6f7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.855197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.855853 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.856154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.856399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.857136 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.858724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.869345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1179/2365] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:08:36.873723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:36.885016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff746c-99fe-4189-8d8b-e6a00a56cee4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.889767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503008f-af8a-4a11-9b1f-7b82377354d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.890422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503008f-af8a-4a11-9b1f-7b82377354d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.890704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503008f-af8a-4a11-9b1f-7b82377354d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.890981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503008f-af8a-4a11-9b1f-7b82377354d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.891744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503008f-af8a-4a11-9b1f-7b82377354d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.894572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503008f-af8a-4a11-9b1f-7b82377354d1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.896800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:36.907077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1187/2366] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:08:36.911486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:36.922206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2133-c358-410e-aec6-94ad9cdb2877 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:36.927109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:36.928004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.928285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.928554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] PATH_INFO: `/v3/projects/9d2615678f0d4d5c8dee32ee1dc147a6/users/ae3f8f99ca824586823bc8ac368b8210/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:36.948891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2615678f0d4d5c8dee32ee1dc147a6, user_id=ae3f8f99ca824586823bc8ac368b8210, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:36.951573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:36.966294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1180/2367] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:08:36 2022] PUT /identity/v3/projects/9d2615678f0d4d5c8dee32ee1dc147a6/users/ae3f8f99ca824586823bc8ac368b8210/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:08:36.977454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6d662-0b95-4bb2-8842-f35d3c07f206 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:36.977737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6d662-0b95-4bb2-8842-f35d3c07f206 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:36.978006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6d662-0b95-4bb2-8842-f35d3c07f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:37.008172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-74a6d662-0b95-4bb2-8842-f35d3c07f206 None None] MFA Rules not processed for user `ae3f8f99ca824586823bc8ac368b8210`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:37.009328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74a6d662-0b95-4bb2-8842-f35d3c07f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:37.075775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1188/2368] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:37.087403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:37.089186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:37.165553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:37.179035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087600-d12e-4199-ba60-7dffdf446a87 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:37.183952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cf4d5-dbc4-48e9-800b-c2a10fec4748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:37.184281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf4d5-dbc4-48e9-800b-c2a10fec4748 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:37.184646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf4d5-dbc4-48e9-800b-c2a10fec4748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:37.184986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf4d5-dbc4-48e9-800b-c2a10fec4748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:37.194636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cf4d5-dbc4-48e9-800b-c2a10fec4748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:37.196073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cf4d5-dbc4-48e9-800b-c2a10fec4748 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:37.214760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1181/2369] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:08:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:08:43.464447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152230-c6fe-4f2f-b9e2-559a14919a56 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:43.465055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152230-c6fe-4f2f-b9e2-559a14919a56 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:43.465055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152230-c6fe-4f2f-b9e2-559a14919a56 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:43.466462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1189/2370] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:08:43.472157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c8d83-0e55-4533-956d-37bac6b2eb76 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:43.472790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c8d83-0e55-4533-956d-37bac6b2eb76 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:43.473072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c8d83-0e55-4533-956d-37bac6b2eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:43.534121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4d2c8d83-0e55-4533-956d-37bac6b2eb76 None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:43.535409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4d2c8d83-0e55-4533-956d-37bac6b2eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:43.646273 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1182/2371] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:43.658123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152230-c6fe-4f2f-b9e2-559a14919a56 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:43.659956 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-98152230-c6fe-4f2f-b9e2-559a14919a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:43.739752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152230-c6fe-4f2f-b9e2-559a14919a56 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:43.743352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccd946-1014-42d6-aaa6-16a22f1a4706 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1470011d984f45be788072525f82cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:43.743993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccd946-1014-42d6-aaa6-16a22f1a4706 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:43.744274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccd946-1014-42d6-aaa6-16a22f1a4706 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:43.744543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccd946-1014-42d6-aaa6-16a22f1a4706 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:43.756046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccd946-1014-42d6-aaa6-16a22f1a4706 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:43.757742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccd946-1014-42d6-aaa6-16a22f1a4706 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:43.769060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1190/2372] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:08:43.846267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5354f8-3ef4-44fb-940a-b34a16c533da None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:43.846554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5354f8-3ef4-44fb-940a-b34a16c533da None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:43.846830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5354f8-3ef4-44fb-940a-b34a16c533da None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:43.848209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1183/2373] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:08:43.853061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740cd5c-98ed-4a75-8f0a-fdbe2cb511a0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:43.853345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740cd5c-98ed-4a75-8f0a-fdbe2cb511a0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:43.853620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740cd5c-98ed-4a75-8f0a-fdbe2cb511a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:43.872582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8740cd5c-98ed-4a75-8f0a-fdbe2cb511a0 None None] MFA Rules not processed for user `9bb4c7ed74924ac4ad8f759437891569`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:43.873875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8740cd5c-98ed-4a75-8f0a-fdbe2cb511a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:43.926150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1191/2374] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:43.938591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5354f8-3ef4-44fb-940a-b34a16c533da None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:43.940508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a5354f8-3ef4-44fb-940a-b34a16c533da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:43.955334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5354f8-3ef4-44fb-940a-b34a16c533da None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:43.959578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a816eb-8ad6-47fa-a872-27351e0d8600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:43.960731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a816eb-8ad6-47fa-a872-27351e0d8600 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:43.961080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a816eb-8ad6-47fa-a872-27351e0d8600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:43.961418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a816eb-8ad6-47fa-a872-27351e0d8600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:43.969120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a816eb-8ad6-47fa-a872-27351e0d8600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:43.970619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a816eb-8ad6-47fa-a872-27351e0d8600 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:43.979056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1184/2375] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:08:44.064450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3082-8f6d-4867-b545-5689f3942158 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:44.064759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3082-8f6d-4867-b545-5689f3942158 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:44.065028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3082-8f6d-4867-b545-5689f3942158 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:44.066470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1192/2376] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:08:44.072271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c282bc-dcdf-4f75-9a90-f71cb229b74e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:44.072557 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c282bc-dcdf-4f75-9a90-f71cb229b74e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:44.072880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c282bc-dcdf-4f75-9a90-f71cb229b74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:44.100526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f9c282bc-dcdf-4f75-9a90-f71cb229b74e None None] MFA Rules not processed for user `7d4f967c85db412aacf6c8b441dbdeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:44.100526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f9c282bc-dcdf-4f75-9a90-f71cb229b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:44.112233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1185/2377] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 12:08:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:44.122667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3082-8f6d-4867-b545-5689f3942158 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:44.124577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-190a3082-8f6d-4867-b545-5689f3942158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:44.139866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3082-8f6d-4867-b545-5689f3942158 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:44.143640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:44.144285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:44.144737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:44.145014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:44.155965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:44.157442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:44.168732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1193/2378] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:08:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:08:54.087031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=62 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:54.163466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:08:56.279537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4fba-bc3e-4e55-a5ac-5651314f74d0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:56.279977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4fba-bc3e-4e55-a5ac-5651314f74d0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:56.280462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4fba-bc3e-4e55-a5ac-5651314f74d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:56.301221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a91d4fba-bc3e-4e55-a5ac-5651314f74d0 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:56.302528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a91d4fba-bc3e-4e55-a5ac-5651314f74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:56.362700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1186/2379] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:08:56.374937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:08:56.376535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:56.445092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601ebc-b982-4777-9e71-d16c3d8446e0 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:08:56.450477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa67e9-8bb8-4c7e-8c60-bf079a38a6c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:08:56.451122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa67e9-8bb8-4c7e-8c60-bf079a38a6c5 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:56.451400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa67e9-8bb8-4c7e-8c60-bf079a38a6c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:56.451703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa67e9-8bb8-4c7e-8c60-bf079a38a6c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:56.460061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa67e9-8bb8-4c7e-8c60-bf079a38a6c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:08:56.461696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa67e9-8bb8-4c7e-8c60-bf079a38a6c5 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:08:56.469951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1194/2380] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:08:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:08:56.634276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f20f57-75a9-4263-b97b-20f479412414 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:08:56.634806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f20f57-75a9-4263-b97b-20f479412414 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:08:56.635394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f20f57-75a9-4263-b97b-20f479412414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:08:56.672384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-98f20f57-75a9-4263-b97b-20f479412414 None None] MFA Rules not processed for user `d059ba56941148f3bb6080ba4f537f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:08:56.673865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-98f20f57-75a9-4263-b97b-20f479412414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:08:56.765983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1187/2381] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:06.466515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=32 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:06.757992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=50 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:20.494019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777851-9dec-4faa-9d0e-0a8b26f27429 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:20.494507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777851-9dec-4faa-9d0e-0a8b26f27429 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:20.494621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777851-9dec-4faa-9d0e-0a8b26f27429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:20.514276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-87777851-9dec-4faa-9d0e-0a8b26f27429 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:20.515835 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-87777851-9dec-4faa-9d0e-0a8b26f27429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:20.528372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1195/2382] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:20.543856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f20f57-75a9-4263-b97b-20f479412414 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:20.559689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f20f57-75a9-4263-b97b-20f479412414 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:20.567425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3761-110a-4b21-8d22-3a5e2a11efee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:20.568208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3761-110a-4b21-8d22-3a5e2a11efee service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:20.568510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3761-110a-4b21-8d22-3a5e2a11efee service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:20.568815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3761-110a-4b21-8d22-3a5e2a11efee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:20.577612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3761-110a-4b21-8d22-3a5e2a11efee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:20.579251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3761-110a-4b21-8d22-3a5e2a11efee service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:20.587819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1188/2383] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:09:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:09:22.010733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777851-9dec-4faa-9d0e-0a8b26f27429 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:22.075709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777851-9dec-4faa-9d0e-0a8b26f27429 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:22.080268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.081176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.081450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.081723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] PATH_INFO: `/v3/users/ae3f8f99ca824586823bc8ac368b8210` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.082913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3f8f99ca824586823bc8ac368b8210)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.085128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.136087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3f8f99ca824586823bc8ac368b8210'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.136755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3f8f99ca824586823bc8ac368b8210'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.145494 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3f8f99ca824586823bc8ac368b8210'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.157884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3f8f99ca824586823bc8ac368b8210'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.165092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3f8f99ca824586823bc8ac368b8210'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.171353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1196/2384] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:09:22 2022] DELETE /identity/v3/users/ae3f8f99ca824586823bc8ac368b8210 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:22.175843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.176382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.176382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.194157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:22.195349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.257330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1189/2385] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:22.264160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:22.265801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.334065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407e4e-1fde-4ab2-b420-323d4ac74077 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:22.337845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbf5d7-2ce8-44dd-a09b-9486615c7403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.338493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf5d7-2ce8-44dd-a09b-9486615c7403 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.338772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf5d7-2ce8-44dd-a09b-9486615c7403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.339046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf5d7-2ce8-44dd-a09b-9486615c7403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.348229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbf5d7-2ce8-44dd-a09b-9486615c7403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.349709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbf5d7-2ce8-44dd-a09b-9486615c7403 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.359443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1197/2386] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:22.655646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:22.657247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.670397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e2e9-12b8-4b2f-afbd-de813b4fdc05 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:22.675584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.676545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.676907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.677240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] PATH_INFO: `/v3/projects/9d2615678f0d4d5c8dee32ee1dc147a6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.678527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2615678f0d4d5c8dee32ee1dc147a6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.680857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.728970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2615678f0d4d5c8dee32ee1dc147a6', 'request_id': 'req-7ec53219-0953-4330-9fe5-1fa9d424f867'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.734402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2615678f0d4d5c8dee32ee1dc147a6', 'request_id': 'req-7ec53219-0953-4330-9fe5-1fa9d424f867'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.740677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2615678f0d4d5c8dee32ee1dc147a6', 'request_id': 'req-7ec53219-0953-4330-9fe5-1fa9d424f867'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.754494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] The token cache is being invalidate because project 9d2615678f0d4d5c8dee32ee1dc147a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:22.754774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.755364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7ec53219-0953-4330-9fe5-1fa9d424f867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.757124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1190/2387] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:09:22 2022] DELETE /identity/v3/projects/9d2615678f0d4d5c8dee32ee1dc147a6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:22.763661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1b067-b23c-49c9-a7a2-90fca82466f4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.763945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1b067-b23c-49c9-a7a2-90fca82466f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.764245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1b067-b23c-49c9-a7a2-90fca82466f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.783010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6de1b067-b23c-49c9-a7a2-90fca82466f4 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:22.784217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6de1b067-b23c-49c9-a7a2-90fca82466f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.794680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:22.847471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1198/2388] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:22.855141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7907f7-7a53-4b92-8bf7-7a1ad897b351 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.855337 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7907f7-7a53-4b92-8bf7-7a1ad897b351 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.855555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7907f7-7a53-4b92-8bf7-7a1ad897b351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.876922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fb7907f7-7a53-4b92-8bf7-7a1ad897b351 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:22.878443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fb7907f7-7a53-4b92-8bf7-7a1ad897b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.886831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1191/2389] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:22.891059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1b067-b23c-49c9-a7a2-90fca82466f4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:22.901560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1b067-b23c-49c9-a7a2-90fca82466f4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:22.906673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.907327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.907605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.907879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.908667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:22.908967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.910567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.922154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1199/2390] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:22.926402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7907f7-7a53-4b92-8bf7-7a1ad897b351 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:22.935608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7907f7-7a53-4b92-8bf7-7a1ad897b351 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:22.940508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.941245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.941520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.941786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.942478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.944399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.971784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1192/2391] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:09:22 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:22.976823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:22.987208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7962a6f-443f-4626-9c16-c74ae5c09e6c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.043422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.044178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.044343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.044612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.045323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.047263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.070844 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1200/2392] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:09:22 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:23.075110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.085591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe169-7d96-4be0-8aca-8c24cdf659d8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.090544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.091187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.091463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.091723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.092473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.094086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.104826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1193/2393] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:23.109106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.124298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0ed4-1fdf-4b8e-b7b6-4a58bfeed272 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.131626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01ec7-8d56-4c9a-8673-e20bcb331f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.132580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01ec7-8d56-4c9a-8673-e20bcb331f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.133064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01ec7-8d56-4c9a-8673-e20bcb331f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.133556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01ec7-8d56-4c9a-8673-e20bcb331f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.134334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01ec7-8d56-4c9a-8673-e20bcb331f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.135984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01ec7-8d56-4c9a-8673-e20bcb331f07 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.146437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1201/2394] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:09:23.151943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.164845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91117e42-34fa-4e4e-a20c-6335e0e9b678 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.169633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.170533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.170820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.171082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] PATH_INFO: `/v3/projects/001dbbfdeb144324a63e61d08b223d4a/users/83172bbdd6504306a37209226b3f4021/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.186765 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001dbbfdeb144324a63e61d08b223d4a, user_id=83172bbdd6504306a37209226b3f4021, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.189471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.205679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1194/2395] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:09:23 2022] PUT /identity/v3/projects/001dbbfdeb144324a63e61d08b223d4a/users/83172bbdd6504306a37209226b3f4021/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:23.216573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14231f-bcb9-4cf7-98d9-f5f1094de34c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.216895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14231f-bcb9-4cf7-98d9-f5f1094de34c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.217170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14231f-bcb9-4cf7-98d9-f5f1094de34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.244096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dc14231f-bcb9-4cf7-98d9-f5f1094de34c None None] MFA Rules not processed for user `83172bbdd6504306a37209226b3f4021`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:23.245335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dc14231f-bcb9-4cf7-98d9-f5f1094de34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:23.313451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1202/2396] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:23.324325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.326513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:23.337956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:23.389717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af846f-2723-441f-b105-ee8de7642a79 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.393704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d33e88-2c6b-435f-978f-33d881d2b984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.394349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d33e88-2c6b-435f-978f-33d881d2b984 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.394626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d33e88-2c6b-435f-978f-33d881d2b984 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.394897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d33e88-2c6b-435f-978f-33d881d2b984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.403641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d33e88-2c6b-435f-978f-33d881d2b984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.405115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d33e88-2c6b-435f-978f-33d881d2b984 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.414057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1195/2397] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:33.310755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:33.410148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=23 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:36.749090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14231f-bcb9-4cf7-98d9-f5f1094de34c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.818565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14231f-bcb9-4cf7-98d9-f5f1094de34c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.824465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.825392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.825672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.825946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] PATH_INFO: `/v3/users/83172bbdd6504306a37209226b3f4021` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.827369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83172bbdd6504306a37209226b3f4021)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.829394 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.883158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83172bbdd6504306a37209226b3f4021'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:36.883804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83172bbdd6504306a37209226b3f4021'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:36.892877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83172bbdd6504306a37209226b3f4021'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:36.907162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83172bbdd6504306a37209226b3f4021'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:36.914619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83172bbdd6504306a37209226b3f4021'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:36.921064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1203/2398] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:09:36 2022] DELETE /identity/v3/users/83172bbdd6504306a37209226b3f4021 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:36.925878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.926356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.926472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.943906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:36.945130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:37.014515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1196/2399] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:37.024675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:37.026322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:37.088244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb749-0c37-4ff3-b960-54c43e427812 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:37.092412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:37.093107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:37.093387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:37.093654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:37.103935 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:37.106123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:37.118481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1204/2400] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:37.397991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:37.399591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:37.413089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150e3c-b2f6-4e74-a77e-9408327616f5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:37.419622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:37.420849 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:37.421213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:37.421687 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] PATH_INFO: `/v3/projects/001dbbfdeb144324a63e61d08b223d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:37.423176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=001dbbfdeb144324a63e61d08b223d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:37.425254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:37.478824 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001dbbfdeb144324a63e61d08b223d4a', 'request_id': 'req-fe236a71-b41c-410b-99c8-a5a17c306455'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:37.485071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001dbbfdeb144324a63e61d08b223d4a', 'request_id': 'req-fe236a71-b41c-410b-99c8-a5a17c306455'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:37.491768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001dbbfdeb144324a63e61d08b223d4a', 'request_id': 'req-fe236a71-b41c-410b-99c8-a5a17c306455'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:37.519200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] The token cache is being invalidate because project 001dbbfdeb144324a63e61d08b223d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:37.519516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:37.520143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:37.521752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1197/2401] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:09:37 2022] DELETE /identity/v3/projects/001dbbfdeb144324a63e61d08b223d4a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:47.111904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:47.515893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:20.350904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.360552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdbbcb-8a14-4eb0-a4e2-7093df381de8 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.423872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d165-663e-48ce-b397-bf78fbf8ca5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.424922 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d165-663e-48ce-b397-bf78fbf8ca5a service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.425259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d165-663e-48ce-b397-bf78fbf8ca5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.425556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d165-663e-48ce-b397-bf78fbf8ca5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.427523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f553d165-663e-48ce-b397-bf78fbf8ca5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.504223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553d165-663e-48ce-b397-bf78fbf8ca5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.505727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553d165-663e-48ce-b397-bf78fbf8ca5a service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.518573 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1205/2402] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:22.295077 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.296720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:22.311456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236a71-b41c-410b-99c8-a5a17c306455 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.317607 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.318256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.318529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.318794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.320894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:22.335223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.336692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.347970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1198/2403] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:10:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:28.382285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:28.382781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:28.382875 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:28.400987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] MFA Rules not processed for user `36415049be5d4238a0275db21a8f378a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:28.402168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:28.457851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1206/2404] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:10:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:28.469134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:28.470642 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:28.485778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af8b1-f48b-49e4-85ae-dc90904f6645 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:28.491762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:28.492392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:28.492682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:28.492959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:28.494796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:28.505953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:28.507524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:28.516788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1199/2405] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:10:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:32.566932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.568601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:32.627901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:32.633846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6448f3-24e8-40be-a7e5-a439ff4310aa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.637456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.638101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.638378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.638648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.640567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:32.701303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.702763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.712137 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1207/2406] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:10:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:37.633453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.635072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:37.648392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f55da-99f9-49d0-b7d1-ca6dc5b7b792 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.651831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.652456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.652768 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.653044 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.654842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:37.664130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.665599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.675773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1200/2407] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:42.707972 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=27 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:43.118264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:43.120011 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:43.138072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2836-3ec3-482d-bb9d-5b0c4e508403 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:43.145276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:43.145941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:43.146223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:43.146492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:43.148819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:43.210268 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:43.211920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:43.221914 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1208/2408] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:10:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:47.670152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=18 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:53.217848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=28 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:55.417204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:55.431677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd5e2-2f61-4e55-9ddc-7fb2bf652ce8 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:55.439420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:55.440049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:55.440321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:55.440586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:55.443308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:55.511100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:55.512925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:55.523191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1201/2409] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:11:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:12:05.519408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=28 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:12.665984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:12.679417 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59936e4-69fb-49e2-af28-d247e73102d6 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:12.686701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:12.687344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:12.687619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:12.687890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:12.690001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:12.751531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:12.753215 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:12.762322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1209/2410] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:22.758112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=28 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:25.487459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:25.489068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:25.501789 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7a54-23ba-4d0f-9bee-cefbd564e632 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:25.505986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:25.506623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:25.506909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:25.507177 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:25.508979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:25.572222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:25.573684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:25.583200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1202/2411] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:35.578580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=28 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:14:31.245222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:31.247851 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:31.333044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3483f93-27ef-4bab-84be-1984a464de73 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:31.338617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:31.339271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:31.339539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:31.339820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:31.341865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:31.354977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:31.356760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:31.366667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1210/2412] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:14:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:41.362625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=32 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:25.673022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:16:25.682265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754f21-ccfd-45b1-8688-c88525abade1 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:16:25.686810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:16:25.687453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:25.687728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:25.687970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:25.697201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:16:25.698629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:16:25.727582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1203/2413] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:16:28.912869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:16:28.925050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7712-929b-40b3-ae52-a169e1a785ca service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:16:28.930352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:16:28.931249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:28.931570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:28.931888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:28.940667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:16:28.942123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:16:28.950751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1211/2414] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:16:35.725073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:37.835496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:16:37.844802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be7c2-f07a-4563-b8ad-6e422f3d7ec8 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:16:37.849206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:16:37.849843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:37.850118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:37.850378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:37.861599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:16:37.863014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:16:37.874121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1204/2415] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:16:37.881466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:16:37.891409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70381-7503-44f8-b9cf-34d3b1a2c5ab service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:16:37.895346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:16:37.895971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:37.896244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:37.896513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:37.905409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:16:37.906879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:16:37.934173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1212/2416] 10.222.0.35 () {60 vars in 1396 bytes} [Thu May 19 12:16:37 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:16:37.995037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:16:38.007097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115c7d-2ac4-479d-821e-7cc9b3a45606 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:16:38.010742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:16:38.011382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:38.011655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:38.011918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:38.025839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:16:38.027690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:16:38.041909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1205/2417] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:16:38.180966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:16:38.201334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0756c9-f8e4-4324-b580-e518cb811715 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:16:38.209281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:16:38.209933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:38.210218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:38.210488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:38.226797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:16:38.228398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:16:38.256409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1213/2418] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:16:48.035987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=12 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:48.253855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=32 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:25.776811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:25.796913 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cef5da-4a9e-4865-9be0-294ea3c0846a service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:25.801538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:25.802211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:25.802486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:25.802741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:25.826212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:25.827636 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:25.855767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1206/2419] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:18:35.853302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=24 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:38.267908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:38.269544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:38.361805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7a50b-5688-47de-a2a6-2c2ce7a650a4 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:38.367752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:38.368472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:38.368833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:38.369152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:38.378287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:38.379997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:38.391816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1214/2420] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:19:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:48.386949 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=37 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:25.898662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:25.919837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055957c4-2bfa-4ea8-9e72-b2376dcbd664 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:25.924443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:25.925116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:25.925394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:25.925664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:25.934641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:25.936076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:25.963814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1207/2421] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:35.960979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=17 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:39.071607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:39.173546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074e658-d560-493b-93eb-0ca040a2113b service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:39.180244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:39.180900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:39.181175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:39.181444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:39.189517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:39.191114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:39.218335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1215/2422] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:20:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:49.215459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=48 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:33.907693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:33.909574 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:33.992563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaa40c-cb07-4b41-b6f2-15b05efdae79 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:33.996444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:33.997104 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:33.997384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:33.997647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:33.999621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:34.010047 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.011492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.020299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1208/2423] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:44.016750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=35 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:26.004208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:26.005842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:26.092082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6826-0341-40d3-8044-d2b28b8f402c service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:26.097608 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:26.098263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:26.098521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:26.098815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:26.100971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:26.174967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:26.176424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:26.186274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1216/2424] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:36.181466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=58 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:38.713582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:38.716576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:38.734034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df218f93-e136-45a4-9956-c675837ec661 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:38.738840 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:38.739489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:38.739773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:38.740035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:38.742173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:38.771518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:38.772993 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:38.784082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1209/2425] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:22:38.791436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:38.804441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dbdbe-643c-470d-a517-0eebc564e635 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:38.810999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:38.811928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:38.812296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:38.812676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:38.815912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:38.898551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:38.900027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:38.911309 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1217/2426] 10.222.0.35 () {60 vars in 1396 bytes} [Thu May 19 12:22:38 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:38.960306 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:38.969076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ad1a0-4cf8-44d6-bb80-39d9e59d3190 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:38.972949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:38.973580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:38.973864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:38.974142 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:38.976043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:38.990626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:38.992064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:39.003576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1210/2427] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:48.906617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:48.998501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=17 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:26.330153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:26.338985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430e3b-606b-479d-81b9-11c1f6c7e605 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:26.342955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:26.343592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:26.343868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:26.344140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:26.346095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:26.423329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:26.424940 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:26.434279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1218/2428] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:36.430018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:39.359922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:39.361697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:39.383308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:39.394375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d78352-da9a-44a8-bc0f-be3bcc7c687d service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:39.399596 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:39.400751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:39.401263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:39.401762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:39.404003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:39.482704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53035dbb-5bcd-4f1d-9966-625a92bbb3d6 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:39.488187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:39.488942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:39.489277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:39.489696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:39.492547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:39.518843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:39.520506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:39.529113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:39.530640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:39.539861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1211/2429] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:39.544700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1219/2430] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:49.529619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=32 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:49.538263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:26.616848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:26.627010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99085f3-6a89-4807-9eb6-405816d46b31 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:26.631417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:26.632063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:26.632311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:26.632581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:26.635407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:26.716271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:26.717622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:26.727129 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1212/2431] 10.222.0.35 () {60 vars in 1396 bytes} [Thu May 19 12:26:26 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:26.966954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:26.967862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:26.986223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed7730-407d-4505-b293-7243b616176c service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:26.993220 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:26.994581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:26.995072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:26.995554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:26.998592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:27.109988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:27.111684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:27.126910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1220/2432] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:26:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:29.018218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:29.018794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:29.035486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7bf2-39ed-42c5-9e91-876c76b95106 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:29.042655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:29.043411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:29.043732 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:29.044009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:29.045926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:29.058817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:29.060419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:29.071638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1213/2433] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:37.123884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:39.066877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=39 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:40.886380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:40.896006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f438b5-690a-4478-b217-475e2a26c031 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:40.899721 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:40.900364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:40.900667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:40.900929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:40.909067 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:40.910516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:40.919790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1221/2434] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:26:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:50.916239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:26.370980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:26.382941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91818c8-6e83-42bb-a4f5-189c59ade6fe service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:26.389705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:26.390333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:26.390613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:26.390880 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:26.398912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:26.400478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:26.429109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1214/2435] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:27:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:36.426128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:38.842316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:38.862670 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0027cb1-d1e6-4ebd-9702-4fbbd50861da service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:38.869846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:38.870477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:38.870753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:38.871024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:38.879796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:38.881431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:38.909132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1222/2436] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:27:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:40.279347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:40.295503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837e8eb-5e6e-4245-9326-93e91ef191f9 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:40.299858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:40.300498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:40.300812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:40.301082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:40.313674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:40.315114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:40.327042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1215/2437] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:27:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:41.447287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:41.449032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:41.462833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cdea1-6006-4c6e-ab3a-317be4e6b8c6 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:41.467198 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:41.467846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:41.468163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:41.468451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:41.482826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:41.484327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:41.497077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1223/2438] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:50.321454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:51.490805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=19 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:49.218501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:29:49.289648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a1a3-98b1-409b-a6c3-505024eb7659 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:29:49.294891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:29:49.295535 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:29:49.296183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:29:49.296183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:29:49.305667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:29:49.307242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:29:49.317986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1216/2439] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:29:59.314130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=27 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:30.405503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:30.435484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a083c7-83c3-47a3-a854-64c0652faffe service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:30.439746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:30.440402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:30.440673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:30.440959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:30.450250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:30.451979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:30.479536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1224/2440] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:30.537049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:30.550053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555d263-4440-4675-91bc-46433d96c1c3 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:30.554598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:30.555230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:30.555476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:30.555747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:30.569281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:30.570808 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:30.599567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1217/2441] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:40.476765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=22 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:40.596830 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:27.108825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:31:27.210259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d8e9-394a-449b-a135-6b7d62354270 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:31:27.216713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:31:27.217365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:31:27.217730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:31:27.218005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:31:27.226923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:31:27.228524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:31:27.255480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1225/2442] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:31:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:31:37.252765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=48 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:42.876445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:31:42.878171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:31:42.972211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348687f-7daa-41c4-b420-aa6aaba18ee2 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:31:42.976537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:31:42.977223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:31:42.977503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:31:42.977775 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:31:42.979713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:31:42.989683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:31:42.991097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:31:42.999865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1218/2443] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:31:52.995850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=39 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:27.064182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:27.078823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46ee2b-e6b7-4cef-a656-5bb02cf16b26 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:27.087715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:27.088497 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:27.088882 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:27.089214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:27.091841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:27.170747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:27.172408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:27.182813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1226/2444] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:32:29.729784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:29.739019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a1c1d-bf2a-4bc8-a33c-7485f1aea30e service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:29.743010 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:29.743661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:29.743938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:29.744237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:29.746149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:29.835833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:29.837218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:29.856090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1219/2445] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:32:30.903425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:30.905369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:30.986801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7536f8-12d7-49e4-9488-5670cc0f1c30 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:30.991029 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:30.991694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:30.991980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:30.992246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:31.002588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:31.004054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:31.034062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1227/2446] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:32:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:32:31.822500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:31.835091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f948110-dd47-45c7-a50d-4c8bc3b1cb9f service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:31.839951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:31.842063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:31.842561 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:31.843996 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:31.846221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:31.861662 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:31.863325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:31.885625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1220/2447] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:32:37.959616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:37.962742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:37.983696 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb29a-1f32-445b-8583-c8d541099397 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:37.989320 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:37.990372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:37.990743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:37.991113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] PATH_INFO: `/v3/users/f8e5131aab4e43a18d98e719e83d6268` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:37.992921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e5131aab4e43a18d98e719e83d6268)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:37.995138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:38.043825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e5131aab4e43a18d98e719e83d6268'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.044469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e5131aab4e43a18d98e719e83d6268'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.053257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e5131aab4e43a18d98e719e83d6268'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.058971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:38.069752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e5131aab4e43a18d98e719e83d6268'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.076498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e5131aab4e43a18d98e719e83d6268'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.082848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1228/2448] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:32:37 2022] DELETE /identity/v3/users/f8e5131aab4e43a18d98e719e83d6268 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:32:38.356297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:38.383783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de52eac-f34e-49cd-9fc6-ce3e0b567a9b service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:38.471976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:38.473103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:38.473510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:38.473871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] PATH_INFO: `/v3/projects/1082ac24dda74201ab7a9bf670d83a38` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:38.475209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1082ac24dda74201ab7a9bf670d83a38)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:38.477269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:38.537936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1082ac24dda74201ab7a9bf670d83a38', 'request_id': 'req-b42ce616-6ad1-4d96-a714-19e098008456'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.542795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:38.545684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1082ac24dda74201ab7a9bf670d83a38', 'request_id': 'req-b42ce616-6ad1-4d96-a714-19e098008456'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.554226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1082ac24dda74201ab7a9bf670d83a38', 'request_id': 'req-b42ce616-6ad1-4d96-a714-19e098008456'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.570225 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] The token cache is being invalidate because project 1082ac24dda74201ab7a9bf670d83a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:32:38.570788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.571439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.576001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1221/2449] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:32:38 2022] DELETE /identity/v3/projects/1082ac24dda74201ab7a9bf670d83a38 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:32:38.577822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:38.579768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:38.594436 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee072fd-50df-4656-989d-67e42291d957 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:38.669307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:38.670534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:38.670930 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:38.671297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] PATH_INFO: `/v3/users/d968471a36654dc4af66b1d03eb73b0a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:38.689211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d968471a36654dc4af66b1d03eb73b0a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:38.691437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:38.757630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd968471a36654dc4af66b1d03eb73b0a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.758297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd968471a36654dc4af66b1d03eb73b0a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.768499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd968471a36654dc4af66b1d03eb73b0a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.787720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd968471a36654dc4af66b1d03eb73b0a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.797412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd968471a36654dc4af66b1d03eb73b0a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:38.805737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1229/2450] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:32:38 2022] DELETE /identity/v3/users/d968471a36654dc4af66b1d03eb73b0a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:32:38.995649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:38.999266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:39.031587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce616-6ad1-4d96-a714-19e098008456 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:39.101512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:39.102480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:39.102985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:39.103329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] PATH_INFO: `/v3/projects/52d2993f1b7046c987e930d6590dfd5d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:39.115503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d2993f1b7046c987e930d6590dfd5d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:39.117722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:39.185354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d2993f1b7046c987e930d6590dfd5d', 'request_id': 'req-bd72c554-ef18-4764-873f-1e0e93dbf53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:39.196717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d2993f1b7046c987e930d6590dfd5d', 'request_id': 'req-bd72c554-ef18-4764-873f-1e0e93dbf53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:39.205528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d2993f1b7046c987e930d6590dfd5d', 'request_id': 'req-bd72c554-ef18-4764-873f-1e0e93dbf53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:39.222367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] The token cache is being invalidate because project 52d2993f1b7046c987e930d6590dfd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:32:39.222622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:39.223294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:39.228671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1222/2451] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:32:38 2022] DELETE /identity/v3/projects/52d2993f1b7046c987e930d6590dfd5d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:32:40.133250 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:40.134656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:40.187518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:40.202209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587e3b6-0d2b-4028-8e1a-ef08fec8abab admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:40.266059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:40.266708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:40.267046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:40.267326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:40.269188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:40.291211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:40.292798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:40.351549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:40.353190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:40.358825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72c554-ef18-4764-873f-1e0e93dbf53a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:40.362651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1230/2452] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:32:40.363373 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:40.364240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:40.364516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:40.364820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] PATH_INFO: `/v3/users/19ccb0e5ef064cfda61c913034da54a6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:40.365995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ccb0e5ef064cfda61c913034da54a6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:40.367904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:40.374480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:40.420413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ccb0e5ef064cfda61c913034da54a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.421117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ccb0e5ef064cfda61c913034da54a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.421704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ccb0e5ef064cfda61c913034da54a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.430456 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ccb0e5ef064cfda61c913034da54a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.442994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ccb0e5ef064cfda61c913034da54a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.460351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1223/2453] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:32:40 2022] DELETE /identity/v3/users/19ccb0e5ef064cfda61c913034da54a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:32:40.637661 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:40.649929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a9b7-34af-475a-8cb7-74d5d9fdb01e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:40.709177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:40.709986 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:40.710264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:40.710518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] PATH_INFO: `/v3/projects/b7ffaf0276394eafb5a4ee10ef3ab4d7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:40.711752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ffaf0276394eafb5a4ee10ef3ab4d7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:40.713810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:40.739960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:40.740842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:40.765203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:40.772034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ffaf0276394eafb5a4ee10ef3ab4d7', 'request_id': 'req-5f951066-6934-46f3-86d8-02f89d1304fb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.778037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ffaf0276394eafb5a4ee10ef3ab4d7', 'request_id': 'req-5f951066-6934-46f3-86d8-02f89d1304fb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.784471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ffaf0276394eafb5a4ee10ef3ab4d7', 'request_id': 'req-5f951066-6934-46f3-86d8-02f89d1304fb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.798831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] The token cache is being invalidate because project b7ffaf0276394eafb5a4ee10ef3ab4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:32:40.799234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.799876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.801730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1231/2454] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:32:40 2022] DELETE /identity/v3/projects/b7ffaf0276394eafb5a4ee10ef3ab4d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:32:40.806427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:40.807938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:40.818255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1da52-2634-4377-b442-f7b76af2bd82 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:40.870382 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:40.871608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:40.871608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:40.871608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:40.873822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:40.875329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951066-6934-46f3-86d8-02f89d1304fb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:40.880072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:40.880974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:40.881544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:40.881825 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] PATH_INFO: `/v3/users/705b3c087ded4f2ea9c1cd5c98f7600b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:40.895400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] RBAC: Authorizing `identity:delete_user(user_id=705b3c087ded4f2ea9c1cd5c98f7600b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:40.897410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:40.930897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:40.944536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705b3c087ded4f2ea9c1cd5c98f7600b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.945229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705b3c087ded4f2ea9c1cd5c98f7600b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.953481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705b3c087ded4f2ea9c1cd5c98f7600b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.962459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:40.963867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:40.965189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705b3c087ded4f2ea9c1cd5c98f7600b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.973630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705b3c087ded4f2ea9c1cd5c98f7600b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:40.976328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1224/2455] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:32:40.979879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1232/2456] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:32:40 2022] DELETE /identity/v3/users/705b3c087ded4f2ea9c1cd5c98f7600b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:32:41.085644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:41.087053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:41.097669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc6d40-7b8a-4eca-915f-4d56b3cfff4f service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:41.157016 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:41.157769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:41.158048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:41.158294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:41.160248 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:41.213422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:32:41.214837 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:32:41.251193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:41.252669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:41.264454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:41.265265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1225/2457] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:32:41.289363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40507084-7460-4f44-adb5-c3b809058add admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:32:41.294098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:32:41.294997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:32:41.295270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:32:41.295549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] PATH_INFO: `/v3/projects/8c0aac5837d8498498cd815f58d2e5a8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:32:41.307009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0aac5837d8498498cd815f58d2e5a8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:32:41.309036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:32:41.357673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0aac5837d8498498cd815f58d2e5a8', 'request_id': 'req-9fa2a188-ca20-489f-99c3-290e26ab9854'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:41.362970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0aac5837d8498498cd815f58d2e5a8', 'request_id': 'req-9fa2a188-ca20-489f-99c3-290e26ab9854'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:41.369404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0aac5837d8498498cd815f58d2e5a8', 'request_id': 'req-9fa2a188-ca20-489f-99c3-290e26ab9854'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:41.383727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] The token cache is being invalidate because project 8c0aac5837d8498498cd815f58d2e5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:32:41.384020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:41.384627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:32:41.386226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1233/2458] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:32:41 2022] DELETE /identity/v3/projects/8c0aac5837d8498498cd815f58d2e5a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:32:51.260543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=68 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:51.380903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:42.539336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:42.540977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:42.555061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa4531-993d-4eb2-88ec-d7a2bdbda4b1 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:42.629022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:42.629691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:42.629973 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:42.630249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:42.632066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:42.645672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:42.647537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:42.660266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1226/2459] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:34:52.654436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=34 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:56.200452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:34:56.203065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:56.296239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2a188-ca20-489f-99c3-290e26ab9854 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:34:56.302118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:34:56.302763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:34:56.303054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:34:56.303311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:34:56.305362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:34:56.318385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:34:56.319995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:34:56.333201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1234/2460] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:34:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:06.325761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=37 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:30.102350 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:30.103902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:30.117534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ed20-10b4-4a6a-88b0-aada661a7b1c service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:30.123956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:30.124560 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:30.124855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:30.125122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:30.127053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:30.199410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:30.201042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:30.210912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1227/2461] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:35:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:40.206114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=33 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:41.504308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:36:41.512566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:36:41.589131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d35446-06d0-4ab7-b604-2a320bf5a405 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:36:41.596630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:36:41.597329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:36:41.597613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:36:41.597920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:36:41.599832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] Could not find project: 1082ac24dda74201ab7a9bf670d83a38.: keystone.exception.ProjectNotFound: Could not find project: 1082ac24dda74201ab7a9bf670d83a38. May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 19 12:36:41.613732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:36:41.615165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._validate_token_resources() May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 12:36:41.616804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 12:36:41.619136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 12:36:41.620522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1082ac24dda74201ab7a9bf670d83a38. May 19 12:36:41.620522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application May 19 12:36:41.620522 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1235/2462] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:36:41 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 19 12:36:47.873100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:36:47.874639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:36:47.936201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e294fd0-8e02-43bd-a3f0-62a8dcdf9718 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:36:47.940798 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:36:47.941452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:36:47.941726 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:36:47.942013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:36:47.943938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:36:47.954533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:36:47.956095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:36:47.964531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1228/2463] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:36:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:36:51.603774 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=24 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:57.961049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=26 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:31.014291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:37:31.024500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f443d-d691-4ed9-8d3e-a0eac3f2af62 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:37:31.028884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:37:31.029512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:37:31.029808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:37:31.030055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:37:31.031995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:37:31.106470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:37:31.107908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:37:31.117072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1236/2464] 10.222.0.35 () {60 vars in 1396 bytes} [Thu May 19 12:37:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:37:40.457997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:37:40.467013 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f596929-b639-4150-be09-ceb3b12191cf service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:37:40.471288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:37:40.471921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:37:40.472194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:37:40.472462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:37:40.474362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:37:40.492722 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:37:40.494814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:37:40.507032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1229/2465] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:37:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:37:40.703602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:37:40.717134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdb72f-2f8c-4468-bd1c-fe7c580553a1 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:37:40.723950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:37:40.724587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:37:40.724898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:37:40.725173 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:37:40.727072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:37:40.797910 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:37:40.799507 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:37:40.818257 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1237/2466] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:37:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:37:41.624062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:37:41.626440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:37:41.643244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482556b3-925a-4bf0-ac08-79bebc981189 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:37:41.647926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949207d-46bf-43c9-a460-2c6fc8d523e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:37:41.648562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949207d-46bf-43c9-a460-2c6fc8d523e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:37:41.648874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949207d-46bf-43c9-a460-2c6fc8d523e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:37:41.649144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949207d-46bf-43c9-a460-2c6fc8d523e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:37:41.651255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4949207d-46bf-43c9-a460-2c6fc8d523e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:37:41.665848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949207d-46bf-43c9-a460-2c6fc8d523e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:37:41.667242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949207d-46bf-43c9-a460-2c6fc8d523e7 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:37:41.678421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1230/2467] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:37:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:37:50.815714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=69 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:51.673543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=12 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:31.789874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:38:31.791464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:31.804315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0903cf-c15a-47cf-a874-f5b3b31083b2 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:38:31.808375 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:38:31.809188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:38:31.809648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:38:31.809869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:38:31.811899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:31.887256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:38:31.888788 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:38:31.908580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1238/2468] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:38:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:38:35.435467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:38:35.435945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:38:35.436056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:38:35.463581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] MFA Rules not processed for user `b4113cb440764819996cfffec45e0b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:38:35.464806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:35.473161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1231/2469] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:38:35.807989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:38:35.817443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd35814-4880-4177-91b9-c3f5a9ce7428 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:38:35.821024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:38:35.821659 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:38:35.821938 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:38:35.822208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:38:35.824111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:35.833964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:38:35.835459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:38:35.843379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1239/2470] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:38:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:38:37.199696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:38:37.201255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:37.217270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a56084-fbd7-40f1-b0fa-a79c7388e7f8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:38:37.223327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:38:37.223977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:38:37.224253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:38:37.224522 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:38:37.226608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:37.238446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:38:37.240019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:38:37.250482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1232/2471] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:38:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:38:45.527439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:38:45.529132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:45.547338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaf9bb-96ad-4192-8d40-d5b1a15e6167 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:38:45.552667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:38:45.553364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:38:45.553645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:38:45.553917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:38:45.555706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:45.568194 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:38:45.569884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:38:45.580322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1240/2472] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:38:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:38:47.246372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=12 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:48.935738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:38:48.948395 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d196f3a-7213-419c-bbe8-8cd5e1f11724 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:38:48.954272 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:38:48.954892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:38:48.955170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:38:48.955424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:38:48.957280 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:48.969679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:38:48.971269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:38:48.982330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1233/2473] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:38:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:38:55.576181 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=48 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:58.977972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:02.166658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:02.244409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb93f-266d-4790-b6dd-4d9a6a92433a service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:02.250877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:02.251529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:02.251807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:02.252081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:02.262658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:02.264656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:02.275872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1241/2474] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:12.270961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=22 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:23.957799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:24.018872 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5884-b810-4ae5-a7c0-35da79960b21 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:24.025704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:24.026627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:24.027094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:24.027538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:24.040089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:24.042263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:24.055356 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1234/2475] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:30.615144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:30.647225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5ca59-c04d-4f83-87fd-9b0357c4e5a3 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:30.654386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af693eb-102f-415d-a514-42e5726ae0e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:30.654961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af693eb-102f-415d-a514-42e5726ae0e3 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:30.655292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af693eb-102f-415d-a514-42e5726ae0e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:30.655580 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af693eb-102f-415d-a514-42e5726ae0e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:30.665644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af693eb-102f-415d-a514-42e5726ae0e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:30.667296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af693eb-102f-415d-a514-42e5726ae0e3 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:30.696178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1242/2476] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:31.853888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:31.875390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aae9d2-338b-4b16-90dd-e8829632888f service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:31.879148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:31.879782 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:31.880061 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:31.880331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:31.882123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:31.948365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:31.949860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:31.960111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1235/2477] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:36.988416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbf080-5727-4774-b878-3cb6ac2615af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:36.988942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbf080-5727-4774-b878-3cb6ac2615af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:36.989037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbf080-5727-4774-b878-3cb6ac2615af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:37.035010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0bcbf080-5727-4774-b878-3cb6ac2615af None None] MFA Rules not processed for user `eefde2311ec64430a6ed161238024df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:37.037277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0bcbf080-5727-4774-b878-3cb6ac2615af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:37.049086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1243/2478] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:37.565018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:37.566514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:37.579209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f22efa-c39d-4137-baeb-8c1f516d6336 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:37.584332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbf080-5727-4774-b878-3cb6ac2615af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:37.585161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:37.586042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:37.586317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:37.586583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] PATH_INFO: `/v3/users/b4113cb440764819996cfffec45e0b76` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:37.587827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4113cb440764819996cfffec45e0b76)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:37.589774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:37.595967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbf080-5727-4774-b878-3cb6ac2615af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:37.600832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:37.601158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:37.601409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:37.601702 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:37.603563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:37.613617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:37.615086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:37.623693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1244/2479] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:40:37.642809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4113cb440764819996cfffec45e0b76'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:37.643514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4113cb440764819996cfffec45e0b76'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:37.644117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4113cb440764819996cfffec45e0b76'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:37.652838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4113cb440764819996cfffec45e0b76'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:37.665430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-62da6e9a-0c0e-4415-baab-5c59f146f946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4113cb440764819996cfffec45e0b76'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:37.678566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1236/2480] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:40:37 2022] DELETE /identity/v3/users/b4113cb440764819996cfffec45e0b76 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:37.950724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:37.969544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526bd5a-98e4-4428-8580-32b56e5c2dba service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.043795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.044711 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.044994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.045267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] PATH_INFO: `/v3/projects/50ab5e13c7394e5e91323bc7ed76c5f8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.046567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ab5e13c7394e5e91323bc7ed76c5f8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.048811 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.109239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ab5e13c7394e5e91323bc7ed76c5f8', 'request_id': 'req-890d0697-8f39-4adb-ae63-7b67d927d42d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:38.115651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ab5e13c7394e5e91323bc7ed76c5f8', 'request_id': 'req-890d0697-8f39-4adb-ae63-7b67d927d42d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:38.122586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ab5e13c7394e5e91323bc7ed76c5f8', 'request_id': 'req-890d0697-8f39-4adb-ae63-7b67d927d42d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:38.140115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] The token cache is being invalidate because project 50ab5e13c7394e5e91323bc7ed76c5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:40:38.140229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:38.140853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-890d0697-8f39-4adb-ae63-7b67d927d42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:38.142447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1245/2481] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:40:37 2022] DELETE /identity/v3/projects/50ab5e13c7394e5e91323bc7ed76c5f8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:38.147446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82bc5-6a73-4711-855d-a53fbf66382f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.147826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82bc5-6a73-4711-855d-a53fbf66382f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.148217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82bc5-6a73-4711-855d-a53fbf66382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.190600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:38.236890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3ef82bc5-6a73-4711-855d-a53fbf66382f None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:38.238619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3ef82bc5-6a73-4711-855d-a53fbf66382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:38.314890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1237/2482] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:38.323563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfd6c7-f6a9-4dd7-9078-f47420a44c68 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.325424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfd6c7-f6a9-4dd7-9078-f47420a44c68 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.325804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfd6c7-f6a9-4dd7-9078-f47420a44c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.355738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-45dfd6c7-f6a9-4dd7-9078-f47420a44c68 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:38.359335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45dfd6c7-f6a9-4dd7-9078-f47420a44c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:38.365412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1246/2483] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:38.370040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82bc5-6a73-4711-855d-a53fbf66382f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:38.380253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82bc5-6a73-4711-855d-a53fbf66382f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.385405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.386087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.386450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.386728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.387487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:40:38.387762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.389644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.404700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1238/2484] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:40:38.407887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfd6c7-f6a9-4dd7-9078-f47420a44c68 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:38.417392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfd6c7-f6a9-4dd7-9078-f47420a44c68 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.422868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.423601 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.423966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.424433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.425150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.427071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.441859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:38.468662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1247/2485] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:40:38 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:40:38.469989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:38.480865 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbc7a-f478-4790-8699-11dc1023f411 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.540219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.540941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.541220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.541490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.542182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.544256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.564757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1239/2486] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:40:38 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:40:38.568907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:38.579141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd089b-f182-418d-a9dc-eef8d5c8b5c0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.584222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.584907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.585191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.585466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.586231 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.587898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.598697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1248/2487] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:40:38.604168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:38.614683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f572fe-b18a-407b-9671-f322c5dd0336 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.619721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7eb4bd-c163-4ff5-938c-959758aff8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.620377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eb4bd-c163-4ff5-938c-959758aff8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.620698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eb4bd-c163-4ff5-938c-959758aff8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.620948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7eb4bd-c163-4ff5-938c-959758aff8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.621665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eb4bd-c163-4ff5-938c-959758aff8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.623239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7eb4bd-c163-4ff5-938c-959758aff8cb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.633182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1240/2488] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:40:38.637832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:38.653578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4470c-8acb-4dc2-a0de-51944b524936 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.660887 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.662217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.662562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.662948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] PATH_INFO: `/v3/projects/b61b511258b54d4ea26ca48bc5a2102f/users/a1887411e3ea4bd799b97f3536901212/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.679130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61b511258b54d4ea26ca48bc5a2102f, user_id=a1887411e3ea4bd799b97f3536901212, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.681864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.697714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1249/2489] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:40:38 2022] PUT /identity/v3/projects/b61b511258b54d4ea26ca48bc5a2102f/users/a1887411e3ea4bd799b97f3536901212/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:40:38.708149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.708439 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.708914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.736817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] MFA Rules not processed for user `a1887411e3ea4bd799b97f3536901212`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:38.738014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:38.782958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:38.804401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1241/2490] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:38.815549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:38.817543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:38.898824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba5ce-0f2e-4037-bbfe-2c59c8e00712 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:38.905710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:38.906362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:38.906643 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:38.906919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:38.915768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:38.917411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:38.926239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1250/2491] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:48.071739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:48.074409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:48.135049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ebd6-d215-4b38-9baa-0da98369058e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:48.139295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50dd9-af9d-46e3-ac4d-7fbfb76802c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:48.139935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50dd9-af9d-46e3-ac4d-7fbfb76802c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:48.140209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50dd9-af9d-46e3-ac4d-7fbfb76802c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:48.140474 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50dd9-af9d-46e3-ac4d-7fbfb76802c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:48.142671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-49b50dd9-af9d-46e3-ac4d-7fbfb76802c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:48.211901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50dd9-af9d-46e3-ac4d-7fbfb76802c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:48.213586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50dd9-af9d-46e3-ac4d-7fbfb76802c8 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:48.223604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1242/2492] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:48.687083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:48.697556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d29f1-69a5-408e-84e0-62baaa185d20 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:48.702145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:48.703070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:48.703347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:48.703667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] PATH_INFO: `/v3/users/a1887411e3ea4bd799b97f3536901212` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:48.705278 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1887411e3ea4bd799b97f3536901212)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:48.707199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:48.760794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1887411e3ea4bd799b97f3536901212'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:48.761675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1887411e3ea4bd799b97f3536901212'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:48.771521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1887411e3ea4bd799b97f3536901212'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:48.788117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1887411e3ea4bd799b97f3536901212'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:48.801322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1887411e3ea4bd799b97f3536901212'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:48.814786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1251/2493] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:40:48 2022] DELETE /identity/v3/users/a1887411e3ea4bd799b97f3536901212 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:48.819271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:48.819558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:48.819832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:48.841598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:48.842757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:48.910578 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1243/2494] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:40:48.920303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:48.921786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:48.932864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:48.981093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618803-b212-42ae-80b5-171952f4c458 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:48.984934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d49583-ff86-4b9a-bbc8-94726f061010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:48.985584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d49583-ff86-4b9a-bbc8-94726f061010 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:48.985865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d49583-ff86-4b9a-bbc8-94726f061010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:48.986141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d49583-ff86-4b9a-bbc8-94726f061010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:48.997053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d49583-ff86-4b9a-bbc8-94726f061010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:48.998515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d49583-ff86-4b9a-bbc8-94726f061010 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:49.009382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1252/2495] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:49.337690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:49.340611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:49.360883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d1865-c857-4ad4-8eb1-371180ad96ea None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:49.368088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:49.371399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.372141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.373053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] PATH_INFO: `/v3/projects/b61b511258b54d4ea26ca48bc5a2102f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.374817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61b511258b54d4ea26ca48bc5a2102f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:49.376974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:49.421421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:49.437502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61b511258b54d4ea26ca48bc5a2102f', 'request_id': 'req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:49.445422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61b511258b54d4ea26ca48bc5a2102f', 'request_id': 'req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:49.453544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61b511258b54d4ea26ca48bc5a2102f', 'request_id': 'req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:49.473197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] The token cache is being invalidate because project b61b511258b54d4ea26ca48bc5a2102f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:40:49.473792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:49.474484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7d8f9d75-edf1-4adb-a0cb-a46d9ea252a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:49.476073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1244/2496] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:40:49 2022] DELETE /identity/v3/projects/b61b511258b54d4ea26ca48bc5a2102f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:49.481051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2dd3f-a976-492b-982c-1804b86924a7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.481343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2dd3f-a976-492b-982c-1804b86924a7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.481620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2dd3f-a976-492b-982c-1804b86924a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.504864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-caa2dd3f-a976-492b-982c-1804b86924a7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:49.506099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-caa2dd3f-a976-492b-982c-1804b86924a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:49.568079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1253/2497] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:49.576105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5069b9-e997-407f-84b6-a2cf98249255 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.576526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5069b9-e997-407f-84b6-a2cf98249255 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.576855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5069b9-e997-407f-84b6-a2cf98249255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.594938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3a5069b9-e997-407f-84b6-a2cf98249255 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:49.596149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a5069b9-e997-407f-84b6-a2cf98249255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:49.607800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1245/2498] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:49.608860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2dd3f-a976-492b-982c-1804b86924a7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:49.619603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2dd3f-a976-492b-982c-1804b86924a7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:49.627714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:49.628523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.628841 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.629119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.629856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:40:49.630164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:49.632408 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:49.650594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1254/2499] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:40:49.654603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5069b9-e997-407f-84b6-a2cf98249255 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:49.664731 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5069b9-e997-407f-84b6-a2cf98249255 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:49.670042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:49.670926 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.671425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.671938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.672844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:49.674772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:49.708325 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1246/2500] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:40:49 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:40:49.712715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:49.723345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b62d6-13fe-42fe-85f3-40770427675b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:49.835078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:49.836534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.837102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.838513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.839493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:49.842412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:49.882566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1255/2501] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:40:49 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:40:49.886956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:49.901876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefe5e0-fae0-48b2-8cd4-c6919fea134a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:49.911591 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:49.912279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.912656 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.913157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.914289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:49.917301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:49.934090 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1247/2502] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:40:49.935383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:49.948453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27267-ca11-4f69-ae52-8e5d66cc18d1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:49.962547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820ee4e-aa95-494c-a52b-0f705173f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:49.963723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ee4e-aa95-494c-a52b-0f705173f634 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:49.964131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ee4e-aa95-494c-a52b-0f705173f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:49.964758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ee4e-aa95-494c-a52b-0f705173f634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:49.966750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820ee4e-aa95-494c-a52b-0f705173f634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:49.968947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820ee4e-aa95-494c-a52b-0f705173f634 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:49.986435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1256/2503] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:40:49.990481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:50.004690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7faef-5083-414b-ac48-1a8fe6a7e700 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:50.013291 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:50.014883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:50.014883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:50.014883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] PATH_INFO: `/v3/projects/d0b5f7cd884b4e2480e4222ec642d95c/users/4418bbd45c6e43e6a6938f8d5227bd51/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:50.033852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b5f7cd884b4e2480e4222ec642d95c, user_id=4418bbd45c6e43e6a6938f8d5227bd51, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:50.037430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:50.075672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1248/2504] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:40:49 2022] PUT /identity/v3/projects/d0b5f7cd884b4e2480e4222ec642d95c/users/4418bbd45c6e43e6a6938f8d5227bd51/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:50.077456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:50.077750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:50.078027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:50.110429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] MFA Rules not processed for user `4418bbd45c6e43e6a6938f8d5227bd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:50.112613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:50.122857 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:50.187760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1257/2505] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:50.198622 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:50.200433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:50.274618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59d13d-2c01-4d1a-afc2-351175741fb5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:50.278549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:50.279268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:50.279572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:50.279957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:50.291358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:50.293834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:50.304792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1249/2506] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:51.822542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:51.824152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:51.924028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3c51-a594-4427-867d-3400368196f2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:51.930445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:51.931473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:51.931819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:51.932585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] PATH_INFO: `/v3/users/36415049be5d4238a0275db21a8f378a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:51.934575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36415049be5d4238a0275db21a8f378a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:51.936687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:51.994965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36415049be5d4238a0275db21a8f378a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:51.995619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36415049be5d4238a0275db21a8f378a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.004812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36415049be5d4238a0275db21a8f378a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.018486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36415049be5d4238a0275db21a8f378a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.026164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e460381d-82da-45f5-b36c-aded045e4ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36415049be5d4238a0275db21a8f378a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.034370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1258/2507] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:40:51 2022] DELETE /identity/v3/users/36415049be5d4238a0275db21a8f378a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:52.251190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.266117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf613349-883e-46c3-9adc-ecb245957696 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:52.315512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:52.326885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:52.328075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.328361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.328699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] PATH_INFO: `/v3/projects/0ce848ee51f841638902e08ea1c2af28` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.329987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce848ee51f841638902e08ea1c2af28)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:52.331956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:52.381098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce848ee51f841638902e08ea1c2af28', 'request_id': 'req-e11379dd-747f-4d1f-95c1-c40d65b21fd0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.386852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce848ee51f841638902e08ea1c2af28', 'request_id': 'req-e11379dd-747f-4d1f-95c1-c40d65b21fd0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.393078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce848ee51f841638902e08ea1c2af28', 'request_id': 'req-e11379dd-747f-4d1f-95c1-c40d65b21fd0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.407573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] The token cache is being invalidate because project 0ce848ee51f841638902e08ea1c2af28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:40:52.407858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.408480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e11379dd-747f-4d1f-95c1-c40d65b21fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:52.410106 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1250/2508] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:40:52 2022] DELETE /identity/v3/projects/0ce848ee51f841638902e08ea1c2af28 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:52.415228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69c17-d992-42c5-9f12-0c3f87ff8363 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.415483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69c17-d992-42c5-9f12-0c3f87ff8363 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.415765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69c17-d992-42c5-9f12-0c3f87ff8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.433893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f7f69c17-d992-42c5-9f12-0c3f87ff8363 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:52.435100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f7f69c17-d992-42c5-9f12-0c3f87ff8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:52.455783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:52.500019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1259/2509] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:52.508842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93ee6-f65f-406f-8d36-6b30401f7a9b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.509209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93ee6-f65f-406f-8d36-6b30401f7a9b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.509450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b93ee6-f65f-406f-8d36-6b30401f7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.529194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f3b93ee6-f65f-406f-8d36-6b30401f7a9b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:52.530422 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3b93ee6-f65f-406f-8d36-6b30401f7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:52.538752 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1251/2510] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:52.543097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69c17-d992-42c5-9f12-0c3f87ff8363 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.553735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69c17-d992-42c5-9f12-0c3f87ff8363 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:52.558543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:52.559202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.559481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.559752 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.560483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:40:52.560831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:52.562444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:52.574615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1260/2511] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:40:52.579377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93ee6-f65f-406f-8d36-6b30401f7a9b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.589457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b93ee6-f65f-406f-8d36-6b30401f7a9b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:52.594261 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:52.594877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.595152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.595418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.596108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:52.598120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:52.626370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1252/2512] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:40:52 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:40:52.630706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.641344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311796ca-1ce7-4142-afe2-e05cd041bf0f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:52.700118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:52.700858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.701141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.701411 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.702101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:52.704022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:52.724492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1261/2513] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:40:52 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:40:52.728696 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.739820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adeef3-b616-4415-acff-5ce3a9c49ee9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:52.745628 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:52.746287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.746549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.746814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.747536 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:52.749162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:52.759654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1253/2514] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:40:52.763712 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.774016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541ffff-8483-4e3e-b68f-d03c7499d898 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:52.779425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b63682-f363-4447-9a3d-efbf1af4dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:52.780082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63682-f363-4447-9a3d-efbf1af4dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.780368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63682-f363-4447-9a3d-efbf1af4dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.780673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b63682-f363-4447-9a3d-efbf1af4dcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.781410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b63682-f363-4447-9a3d-efbf1af4dcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:52.783024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b63682-f363-4447-9a3d-efbf1af4dcd8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:52.793427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1262/2515] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:40:52.797554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.807948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5dad-8fef-4b22-84a7-dc0a1130f8cc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:52.813664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:52.814551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.814820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.815078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] PATH_INFO: `/v3/projects/0f0a91a3d6a14259b2d03881fdab4f9f/users/1aad8b1af5994d7b9de3a8fb0be556cf/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.830150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0a91a3d6a14259b2d03881fdab4f9f, user_id=1aad8b1af5994d7b9de3a8fb0be556cf, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:52.832819 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:52.848011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1254/2516] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:40:52 2022] PUT /identity/v3/projects/0f0a91a3d6a14259b2d03881fdab4f9f/users/1aad8b1af5994d7b9de3a8fb0be556cf/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:52.853230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:52.853714 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:52.853817 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:52.872399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:52.873662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:52.934919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1263/2517] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:52.945940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:52.947965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:53.007586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3765eb-8423-45dc-96b4-da4939e0715b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:53.011697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716e97b-f454-4f0b-ad59-3c9ea42a1fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:53.012330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716e97b-f454-4f0b-ad59-3c9ea42a1fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:53.012605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716e97b-f454-4f0b-ad59-3c9ea42a1fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:53.012900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716e97b-f454-4f0b-ad59-3c9ea42a1fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:53.022462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716e97b-f454-4f0b-ad59-3c9ea42a1fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:53.023874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716e97b-f454-4f0b-ad59-3c9ea42a1fb5 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:53.033925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1255/2518] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:57.886813 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:57.888537 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:57.904095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578036-751d-4606-8200-cefcee4e2d5c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:57.908853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:57.909812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:57.910274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:57.910706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:57.913361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:57.931740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:57.933982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:57.946159 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1264/2519] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:58.362757 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:58.363219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:58.363219 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:58.395413 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] MFA Rules not processed for user `1aad8b1af5994d7b9de3a8fb0be556cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:58.396710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:58.407594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:58.492601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1256/2520] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:58.510579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:58.513022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:58.551401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:58.623734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525605b-395b-4413-8b96-6ada2aa1433c service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:58.630080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:58.630810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:58.631153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:58.631689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:58.642390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:58.644069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:58.653737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1265/2521] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:58.674349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:58.675886 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:58.690312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a271202-ca6c-421e-8fdd-397b92ec7705 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:58.694877 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:58.695753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:58.696033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:58.696302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] PATH_INFO: `/v3/users/d059ba56941148f3bb6080ba4f537f9d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:58.697555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d059ba56941148f3bb6080ba4f537f9d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:58.699478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:58.752988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd059ba56941148f3bb6080ba4f537f9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:58.753675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd059ba56941148f3bb6080ba4f537f9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:58.754258 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd059ba56941148f3bb6080ba4f537f9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:58.763604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd059ba56941148f3bb6080ba4f537f9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:58.776733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b255f0e1-4344-41eb-bc62-740fd52a8fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd059ba56941148f3bb6080ba4f537f9d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:58.792619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1257/2522] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:40:58 2022] DELETE /identity/v3/users/d059ba56941148f3bb6080ba4f537f9d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:58.969943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:58.982146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f8dcf-557c-40fa-9178-09cebf049c9d service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.059628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.060575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.060943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.061279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] PATH_INFO: `/v3/projects/92c49142ea324049ba24b55ff84e5a3b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.062569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c49142ea324049ba24b55ff84e5a3b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.064630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.121000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c49142ea324049ba24b55ff84e5a3b', 'request_id': 'req-c16d5d77-3156-4e96-b261-b30611405f4f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.129030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c49142ea324049ba24b55ff84e5a3b', 'request_id': 'req-c16d5d77-3156-4e96-b261-b30611405f4f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.136022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c49142ea324049ba24b55ff84e5a3b', 'request_id': 'req-c16d5d77-3156-4e96-b261-b30611405f4f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.150667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] The token cache is being invalidate because project 92c49142ea324049ba24b55ff84e5a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:40:59.150950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.151690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c16d5d77-3156-4e96-b261-b30611405f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.153609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1266/2523] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:40:58 2022] DELETE /identity/v3/projects/92c49142ea324049ba24b55ff84e5a3b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:59.158583 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b15ddd-98e5-406e-bf11-fe2ab357ea73 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.159057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b15ddd-98e5-406e-bf11-fe2ab357ea73 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.159201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b15ddd-98e5-406e-bf11-fe2ab357ea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.178772 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-61b15ddd-98e5-406e-bf11-fe2ab357ea73 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:59.180688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-61b15ddd-98e5-406e-bf11-fe2ab357ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:59.244585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1258/2524] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:59.252330 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.252617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.252928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.273539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:59.276602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:59.285264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1267/2525] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:59.289486 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b15ddd-98e5-406e-bf11-fe2ab357ea73 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.303148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.304551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:59.306549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b15ddd-98e5-406e-bf11-fe2ab357ea73 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.313890 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.315960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.315960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.315960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.317232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:40:59.317657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.319464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.321762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c494d5-83e0-4c85-b545-008172ac9dfd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.330544 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.331488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.331758 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.332222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] PATH_INFO: `/v3/users/4418bbd45c6e43e6a6938f8d5227bd51` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.334422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4418bbd45c6e43e6a6938f8d5227bd51)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.336679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1259/2526] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:40:59.339378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.340102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.351457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db9525-6247-400d-9fd3-1810853edb07 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.356360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.357086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.357397 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.358189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.358949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.361302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.366139 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:59.382443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:59.399181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1260/2527] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:40:59 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:40:59.404166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.423895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4418bbd45c6e43e6a6938f8d5227bd51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.424907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4418bbd45c6e43e6a6938f8d5227bd51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.437219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4418bbd45c6e43e6a6938f8d5227bd51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.456077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4418bbd45c6e43e6a6938f8d5227bd51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.468010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ae37428f-084c-40a3-b2a9-04325f3a3c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4418bbd45c6e43e6a6938f8d5227bd51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:40:59.479264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1268/2528] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:40:59 2022] DELETE /identity/v3/users/4418bbd45c6e43e6a6938f8d5227bd51 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:40:59.484008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.484292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.484563 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.499844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0b97b-ff6a-4a32-9d74-3c42e88cf486 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.521237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:59.522490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:59.572689 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.573719 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.573996 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.574265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.575018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.577450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.605900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1261/2529] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:40:59 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:40:59.609817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.610188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1269/2530] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:59.618791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:59.621372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.622763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:59.632004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b14145-da2e-4627-93c3-3b5f524cf1c0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.645619 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.646352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.646634 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.646907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.647673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.649465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.663144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1262/2531] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:40:59.669822 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.682510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84645fd-d53d-4f8b-b8e6-295b0ae00299 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.688479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.689608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.690012 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.690445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.691495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.693284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.704201 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b26f2-09df-41d9-820c-b7b568450cf5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.708106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1e67f-ca31-4996-a5f0-2af283807eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.708834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e67f-ca31-4996-a5f0-2af283807eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.709114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e67f-ca31-4996-a5f0-2af283807eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.709380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e67f-ca31-4996-a5f0-2af283807eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.713605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1263/2532] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:40:59.714551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:40:59.720463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1e67f-ca31-4996-a5f0-2af283807eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.722000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1e67f-ca31-4996-a5f0-2af283807eb1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.728463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8aa70-551c-422a-8d33-53ff97d9a8a0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:40:59.735548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:40:59.737034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.737404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.737693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] PATH_INFO: `/v3/projects/a76f72af8d47404980293788d97edb2e/users/f725498599d84b3782c0e0d46131463a/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.745546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1270/2533] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:40:59.760631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76f72af8d47404980293788d97edb2e, user_id=f725498599d84b3782c0e0d46131463a, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:40:59.764067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:40:59.789994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1264/2534] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:40:59 2022] PUT /identity/v3/projects/a76f72af8d47404980293788d97edb2e/users/f725498599d84b3782c0e0d46131463a/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:40:59.795756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03354ef9-4f96-48cc-936a-c78d317c0fa6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:40:59.796075 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03354ef9-4f96-48cc-936a-c78d317c0fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:40:59.796350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03354ef9-4f96-48cc-936a-c78d317c0fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:40:59.820353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-03354ef9-4f96-48cc-936a-c78d317c0fa6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:40:59.822569 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03354ef9-4f96-48cc-936a-c78d317c0fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:40:59.885978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:59.912274 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1271/2535] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:40:59.934437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:00.003720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:00.025433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdae83-7186-4d31-b2ca-30b9f3f8a9b9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:00.030884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:00.031882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:00.032411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:00.032946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:00.045750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:00.048549 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:00.062761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1265/2536] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:00.193831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b212a8-4ced-490e-9b35-03f6e8e95bb5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:00.194437 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b212a8-4ced-490e-9b35-03f6e8e95bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:00.194612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b212a8-4ced-490e-9b35-03f6e8e95bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:00.208180 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:00.210140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:00.236835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f7af-4095-4cea-89eb-3485f9016545 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:00.237466 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-88b212a8-4ced-490e-9b35-03f6e8e95bb5 None None] MFA Rules not processed for user `1aad8b1af5994d7b9de3a8fb0be556cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:00.240260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-88b212a8-4ced-490e-9b35-03f6e8e95bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:00.246713 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:00.248360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:00.249419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:00.249959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] PATH_INFO: `/v3/projects/d0b5f7cd884b4e2480e4222ec642d95c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:00.252250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b5f7cd884b4e2480e4222ec642d95c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:00.258211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:00.350324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b5f7cd884b4e2480e4222ec642d95c', 'request_id': 'req-37606ec6-2f1b-43f0-9003-ce77d418ae9a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:00.360911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b5f7cd884b4e2480e4222ec642d95c', 'request_id': 'req-37606ec6-2f1b-43f0-9003-ce77d418ae9a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:00.372721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b5f7cd884b4e2480e4222ec642d95c', 'request_id': 'req-37606ec6-2f1b-43f0-9003-ce77d418ae9a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:00.392330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] The token cache is being invalidate because project d0b5f7cd884b4e2480e4222ec642d95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:00.392874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:00.393816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-37606ec6-2f1b-43f0-9003-ce77d418ae9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:00.400688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1266/2537] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:00 2022] DELETE /identity/v3/projects/d0b5f7cd884b4e2480e4222ec642d95c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:41:00.404298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a578893-2432-4e85-8c2a-a6da8f404674 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:00.406585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a578893-2432-4e85-8c2a-a6da8f404674 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:00.408674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a578893-2432-4e85-8c2a-a6da8f404674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:00.436005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1272/2538] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:41:00.478818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3a578893-2432-4e85-8c2a-a6da8f404674 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:00.480102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a578893-2432-4e85-8c2a-a6da8f404674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:00.619675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1267/2539] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:00.622556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51b02-2336-4d97-bb49-404426732628 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:00.623034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51b02-2336-4d97-bb49-404426732628 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:00.623705 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51b02-2336-4d97-bb49-404426732628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:00.652305 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cdd51b02-2336-4d97-bb49-404426732628 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:00.653827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cdd51b02-2336-4d97-bb49-404426732628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:00.671016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1273/2540] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:00.676614 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a578893-2432-4e85-8c2a-a6da8f404674 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:00.690214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a578893-2432-4e85-8c2a-a6da8f404674 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:00.703479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:00.704309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:00.704735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:00.704950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:00.705624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:41:00.705940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:00.707705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:00.753469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd51b02-2336-4d97-bb49-404426732628 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:00.754266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1268/2541] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:41:00.767698 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd51b02-2336-4d97-bb49-404426732628 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:00.779899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:00.780998 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:00.781521 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:00.781967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:00.783093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:00.787784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:00.855575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1274/2542] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:00 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:00.861430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:00.877120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3d6d3-4771-4ff2-bdc4-a6aaaf3cf286 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:01.011854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:01.036264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:01.037400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:01.037779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:01.039754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:01.040860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:01.046604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:01.091710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1269/2543] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:00 2022] POST /identity/v3/users => generated 279 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:01.095848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:01.109498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd6564-2a44-40ba-871c-9a4ed1f33d38 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:01.125626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:01.128196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:01.128691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:01.129158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:01.134929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:01.140760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:01.164551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1275/2544] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:41:01.169088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:01.182976 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60277-79c7-4989-8ef1-0471d2ee826d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:01.201796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2c19-dad6-411d-a109-3bc429560f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:01.202407 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2c19-dad6-411d-a109-3bc429560f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:01.202685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2c19-dad6-411d-a109-3bc429560f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:01.202960 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2c19-dad6-411d-a109-3bc429560f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:01.203724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2c19-dad6-411d-a109-3bc429560f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:01.205532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2c19-dad6-411d-a109-3bc429560f2d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:01.266335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1270/2545] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:01.266771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:01.278235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b6e0f-67ab-4eb3-9e24-728c3dc2f0d9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:01.287768 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:01.288929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:01.289400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:01.289839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] PATH_INFO: `/v3/projects/d083ecadcdad4605bc6eb5b103112f93/users/ac822e1438af4396880cabee59f7e15e/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:01.330407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d083ecadcdad4605bc6eb5b103112f93, user_id=ac822e1438af4396880cabee59f7e15e, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:01.336356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:01.373254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1276/2546] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:01 2022] PUT /identity/v3/projects/d083ecadcdad4605bc6eb5b103112f93/users/ac822e1438af4396880cabee59f7e15e/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:01.386881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd8f3-8cf2-4ca0-9e85-6ab2928cefc9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:01.388307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd8f3-8cf2-4ca0-9e85-6ab2928cefc9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:01.388886 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd8f3-8cf2-4ca0-9e85-6ab2928cefc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:01.447080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-77fbd8f3-8cf2-4ca0-9e85-6ab2928cefc9 None None] MFA Rules not processed for user `ac822e1438af4396880cabee59f7e15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:01.449066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-77fbd8f3-8cf2-4ca0-9e85-6ab2928cefc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:01.612359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1271/2547] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:01.622002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:01.742570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53500dc6-26b1-4c95-ba89-23c3e1d2e9ae admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:01.749062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:01.749751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:01.750065 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:01.750387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:01.751142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:01.753570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:01.806641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1277/2548] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:01 2022] POST /identity/v3/projects => generated 353 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:01.810611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd8f3-8cf2-4ca0-9e85-6ab2928cefc9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:01.833091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd8f3-8cf2-4ca0-9e85-6ab2928cefc9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:01.982092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:01.983004 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:01.983529 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:01.984020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:01.984860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:01.986986 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:02.024888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1272/2549] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:01 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:02.029804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:02.047131 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f0672-5906-4563-887a-b8c8cff67eab admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:02.060499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:02.061695 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:02.062157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:02.062592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:02.063512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:02.066888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:02.077961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:02.093735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1278/2550] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:02.098770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:02.124163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021636-3177-4646-b1bc-0d038ea83b0b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:02.139056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:02.140989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:02.141375 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:02.141864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] PATH_INFO: `/v3/projects/e974e4dc69fe429f938adb0427eb5d19/users/7f2f36c124bc43e1a74d760f748e1962/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:02.181845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e974e4dc69fe429f938adb0427eb5d19, user_id=7f2f36c124bc43e1a74d760f748e1962, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:02.184794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:02.226506 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:02.229581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1273/2551] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:02 2022] PUT /identity/v3/projects/e974e4dc69fe429f938adb0427eb5d19/users/7f2f36c124bc43e1a74d760f748e1962/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:02.241314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c270bd-0e85-44b8-8696-42bd73d097df admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:02.358469 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ba726-1e8a-4de8-831a-6461fcf160e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:02.360050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba726-1e8a-4de8-831a-6461fcf160e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:02.360510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba726-1e8a-4de8-831a-6461fcf160e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:02.361002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ba726-1e8a-4de8-831a-6461fcf160e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:02.362032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ba726-1e8a-4de8-831a-6461fcf160e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:02.363893 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ba726-1e8a-4de8-831a-6461fcf160e1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:02.379713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1279/2552] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:41:02.380796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:02.400041 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae466e-98ec-4a8b-948c-215d2a840c9c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:02.412005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:02.413103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:02.413664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:02.414030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] PATH_INFO: `/v3/projects/e974e4dc69fe429f938adb0427eb5d19/users/7f2f36c124bc43e1a74d760f748e1962/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:02.419931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e974e4dc69fe429f938adb0427eb5d19, user_id=7f2f36c124bc43e1a74d760f748e1962, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:02.422805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:02.443906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1274/2553] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:02 2022] PUT /identity/v3/projects/e974e4dc69fe429f938adb0427eb5d19/users/7f2f36c124bc43e1a74d760f748e1962/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:02.454226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73299-440e-40cb-9ec9-c67001e65992 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:02.454794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73299-440e-40cb-9ec9-c67001e65992 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:02.455304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73299-440e-40cb-9ec9-c67001e65992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:02.513613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c8c73299-440e-40cb-9ec9-c67001e65992 None None] MFA Rules not processed for user `7f2f36c124bc43e1a74d760f748e1962`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:02.514833 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c8c73299-440e-40cb-9ec9-c67001e65992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:02.657020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1280/2554] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:02.671699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:02.675232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:02.701026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:02.785002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989c3a-3c06-4aaf-a0ba-ec889d655bff admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:02.789567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd1de-09e0-4101-847c-6ebb901cca84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:02.790295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd1de-09e0-4101-847c-6ebb901cca84 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:02.790618 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd1de-09e0-4101-847c-6ebb901cca84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:02.790899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd1de-09e0-4101-847c-6ebb901cca84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:02.804416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd1de-09e0-4101-847c-6ebb901cca84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:02.806515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd1de-09e0-4101-847c-6ebb901cca84 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:02.826502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1275/2555] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:02 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:02.950450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c73299-440e-40cb-9ec9-c67001e65992 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:02.964942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c73299-440e-40cb-9ec9-c67001e65992 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:02.968990 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:02.970018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:02.970328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:02.970725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:03.055056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:03.056766 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:03.069859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1281/2556] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:02 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:05.999140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3713ca-eeb0-4123-8f6a-4d12e23e399c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:06.000005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3713ca-eeb0-4123-8f6a-4d12e23e399c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:06.000483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3713ca-eeb0-4123-8f6a-4d12e23e399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:06.038275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7c3713ca-eeb0-4123-8f6a-4d12e23e399c None None] MFA Rules not processed for user `f725498599d84b3782c0e0d46131463a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:06.039746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7c3713ca-eeb0-4123-8f6a-4d12e23e399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:06.151613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1276/2557] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:06.156628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:06.158630 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:06.187939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:06.259245 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ac1c-1cb6-442d-bd0d-2eb12bf0ed85 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:06.273182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:06.274007 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:06.274293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:06.274669 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:06.276027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:06.278976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:06.326291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1282/2558] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:06 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:06.328174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3713ca-eeb0-4123-8f6a-4d12e23e399c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:06.344367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3713ca-eeb0-4123-8f6a-4d12e23e399c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:06.445322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:06.445933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:06.446256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:06.446595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:06.447292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:06.449331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:06.473290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1277/2559] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:06 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:06.477687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:06.493207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c766591-4349-41e7-9c32-92588d426360 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:06.506295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:06.506994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:06.507275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:06.507694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:06.508476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:06.511049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:06.524550 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1283/2560] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:06.529018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:06.547481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c215ea-f6fe-4fd4-9940-1c82098c3271 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:06.552887 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:06.553788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:06.554064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:06.554332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] PATH_INFO: `/v3/projects/1685e0ba2e2347a1b68437e886949234/users/18814e3a85ac487bb9d0b36905b224f2/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:06.570263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1685e0ba2e2347a1b68437e886949234, user_id=18814e3a85ac487bb9d0b36905b224f2, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:06.572933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:06.587580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1278/2561] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:06 2022] PUT /identity/v3/projects/1685e0ba2e2347a1b68437e886949234/users/18814e3a85ac487bb9d0b36905b224f2/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:41:06.591646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:06.601865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102f01-3478-499b-b7ef-48cc2114b478 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:06.662861 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adb2db-4c47-4d28-af77-b28db363d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:06.663538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adb2db-4c47-4d28-af77-b28db363d499 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:06.663820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adb2db-4c47-4d28-af77-b28db363d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:06.664094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adb2db-4c47-4d28-af77-b28db363d499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:06.664865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adb2db-4c47-4d28-af77-b28db363d499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:06.666713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adb2db-4c47-4d28-af77-b28db363d499 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:06.677282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1284/2562] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:06.681568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:06.692848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544e6f5-7de3-42e0-813d-31a49bdedf78 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:06.697993 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:06.698921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:06.699195 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:06.699509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] PATH_INFO: `/v3/projects/1685e0ba2e2347a1b68437e886949234/users/18814e3a85ac487bb9d0b36905b224f2/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:06.701562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1685e0ba2e2347a1b68437e886949234, user_id=18814e3a85ac487bb9d0b36905b224f2, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:06.704355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:06.707873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:06.717072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1279/2563] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:06 2022] PUT /identity/v3/projects/1685e0ba2e2347a1b68437e886949234/users/18814e3a85ac487bb9d0b36905b224f2/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:12.788964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d323-854d-43d8-9298-c2c886a1cab9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:12.789827 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d323-854d-43d8-9298-c2c886a1cab9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:12.790174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84d323-854d-43d8-9298-c2c886a1cab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:12.817172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9c84d323-854d-43d8-9298-c2c886a1cab9 None None] MFA Rules not processed for user `18814e3a85ac487bb9d0b36905b224f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:12.818448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9c84d323-854d-43d8-9298-c2c886a1cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:12.891556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1285/2564] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:12.904419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:12.906569 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:12.992263 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2f7b4-2b1c-4653-b86b-bb6d6d832184 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:12.997281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1470011d984f45be788072525f82cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:12.998084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:12.998469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:12.998831 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:13.068036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:13.069889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:13.081095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1280/2565] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:13.215961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751249a-1fdd-4cdd-a681-220bea710610 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:13.216420 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751249a-1fdd-4cdd-a681-220bea710610 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:13.216848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751249a-1fdd-4cdd-a681-220bea710610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:13.250233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:13.297122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b751249a-1fdd-4cdd-a681-220bea710610 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:13.298524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b751249a-1fdd-4cdd-a681-220bea710610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:13.377993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1286/2566] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:13.428533 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:13.430135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:13.530908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556c7ed-ffe6-4263-a68f-0ffbe368875a service glance] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:13.537802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24b10d-cd82-4ec5-9b6e-473c41927d20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:13.538467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b10d-cd82-4ec5-9b6e-473c41927d20 service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:13.538745 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b10d-cd82-4ec5-9b6e-473c41927d20 service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:13.539015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24b10d-cd82-4ec5-9b6e-473c41927d20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:13.549030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24b10d-cd82-4ec5-9b6e-473c41927d20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:13.550708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24b10d-cd82-4ec5-9b6e-473c41927d20 service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:13.558639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:13.566617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1281/2567] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:41:20.038209 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751249a-1fdd-4cdd-a681-220bea710610 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:20.125096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751249a-1fdd-4cdd-a681-220bea710610 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:20.130906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:20.131767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:20.132050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:20.132315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] PATH_INFO: `/v3/users/ac822e1438af4396880cabee59f7e15e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:20.133515 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac822e1438af4396880cabee59f7e15e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:20.135473 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:20.231093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac822e1438af4396880cabee59f7e15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.231733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac822e1438af4396880cabee59f7e15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.241402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac822e1438af4396880cabee59f7e15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.255749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac822e1438af4396880cabee59f7e15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.267565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac822e1438af4396880cabee59f7e15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.271968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:20.277912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1287/2568] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:41:20 2022] DELETE /identity/v3/users/ac822e1438af4396880cabee59f7e15e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:20.282359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:20.282893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:20.282893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:20.303199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:20.304794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:20.384299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1282/2569] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:20.393368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:20.394929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:20.462402 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8d538-620e-4ed9-baaa-437f2cefef28 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:20.470316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:20.470977 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:20.471251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:20.471518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:20.481688 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:20.483240 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:20.495744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1288/2570] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:20.810367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:20.812040 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:20.843290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545fae5-7fff-4128-abbe-7b96ecbe1786 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:20.851281 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:20.852192 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:20.852546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:20.852855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] PATH_INFO: `/v3/projects/d083ecadcdad4605bc6eb5b103112f93` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:20.854204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d083ecadcdad4605bc6eb5b103112f93)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:20.856131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:20.917873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd083ecadcdad4605bc6eb5b103112f93', 'request_id': 'req-664f7b3a-761b-4885-8e33-c730b0f41a5c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.927842 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd083ecadcdad4605bc6eb5b103112f93', 'request_id': 'req-664f7b3a-761b-4885-8e33-c730b0f41a5c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.936735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd083ecadcdad4605bc6eb5b103112f93', 'request_id': 'req-664f7b3a-761b-4885-8e33-c730b0f41a5c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.952545 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] The token cache is being invalidate because project d083ecadcdad4605bc6eb5b103112f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:20.953480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.954324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:20.957190 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1283/2571] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:20 2022] DELETE /identity/v3/projects/d083ecadcdad4605bc6eb5b103112f93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:20.961135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:20.971868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfb0f7-235f-4a11-adac-f44829cad7c3 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:21.044227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:21.045136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:21.045413 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:21.045684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] PATH_INFO: `/v3/users/7f2f36c124bc43e1a74d760f748e1962` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:21.046945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2f36c124bc43e1a74d760f748e1962)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:21.049100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:21.107429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2f36c124bc43e1a74d760f748e1962'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.108203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2f36c124bc43e1a74d760f748e1962'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.119249 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2f36c124bc43e1a74d760f748e1962'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.135193 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2f36c124bc43e1a74d760f748e1962'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.148615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-87e46f43-a038-4765-b8b6-eeffb4cdc0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2f36c124bc43e1a74d760f748e1962'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.155206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1289/2572] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:41:20 2022] DELETE /identity/v3/users/7f2f36c124bc43e1a74d760f748e1962 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:21.480366 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:21.481342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:21.497761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7b3a-761b-4885-8e33-c730b0f41a5c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:21.583565 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:21.584442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:21.584756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:21.585032 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] PATH_INFO: `/v3/projects/e974e4dc69fe429f938adb0427eb5d19` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:21.586255 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e974e4dc69fe429f938adb0427eb5d19)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:21.588355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:21.625703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:21.647140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e974e4dc69fe429f938adb0427eb5d19', 'request_id': 'req-e969038d-d9db-4887-821c-df8ca3796918'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.653946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e974e4dc69fe429f938adb0427eb5d19', 'request_id': 'req-e969038d-d9db-4887-821c-df8ca3796918'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.662873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e974e4dc69fe429f938adb0427eb5d19', 'request_id': 'req-e969038d-d9db-4887-821c-df8ca3796918'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.681403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] The token cache is being invalidate because project e974e4dc69fe429f938adb0427eb5d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:21.681762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.682317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e969038d-d9db-4887-821c-df8ca3796918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:21.684113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1284/2573] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:21 2022] DELETE /identity/v3/projects/e974e4dc69fe429f938adb0427eb5d19 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:41:21.688889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc628cd-e40f-4b38-a780-196bea4a74bc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:21.689186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc628cd-e40f-4b38-a780-196bea4a74bc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:21.689463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc628cd-e40f-4b38-a780-196bea4a74bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:21.711114 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9bc628cd-e40f-4b38-a780-196bea4a74bc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:21.712660 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9bc628cd-e40f-4b38-a780-196bea4a74bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:21.731105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:21.788099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1290/2574] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:41:21.796187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a3b4a-f716-450f-92cf-0e66a270d210 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:21.796470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a3b4a-f716-450f-92cf-0e66a270d210 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:21.797504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a3b4a-f716-450f-92cf-0e66a270d210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:21.818134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e67a3b4a-f716-450f-92cf-0e66a270d210 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:21.819690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e67a3b4a-f716-450f-92cf-0e66a270d210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:21.828983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1285/2575] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:21.832356 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc628cd-e40f-4b38-a780-196bea4a74bc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:21.842854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc628cd-e40f-4b38-a780-196bea4a74bc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:21.848202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:21.849021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:21.849404 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:21.849771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:21.850610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:41:21.851018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:21.853243 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:21.866230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1291/2576] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:41:21.870876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a3b4a-f716-450f-92cf-0e66a270d210 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:21.881235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a3b4a-f716-450f-92cf-0e66a270d210 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:21.885998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:21.886770 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:21.887049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:21.887438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:21.888165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:21.890115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:21.923888 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1286/2577] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:21 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:41:21.928074 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:21.941722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9d729-4cd2-49dd-980e-50c34a88180a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.007993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.009160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.009604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.009869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.010566 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.012516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.037273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1292/2578] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:21 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:22.042918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.058806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afef74f-d0e0-4162-8e30-5b21c8a1dccf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.066958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.067708 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.068058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.068393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.069264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.071308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.085813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1287/2579] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:22.087179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.099816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875c44-b09e-47a2-9fbb-b6120c4bf298 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.105078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b57cd-0c68-477e-9291-f11c8a8524db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.105751 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b57cd-0c68-477e-9291-f11c8a8524db admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.106028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b57cd-0c68-477e-9291-f11c8a8524db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.106319 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b57cd-0c68-477e-9291-f11c8a8524db admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.107033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b57cd-0c68-477e-9291-f11c8a8524db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.108735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b57cd-0c68-477e-9291-f11c8a8524db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.120932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1293/2580] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:22.124953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.138659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa06097-8303-4b3c-9202-afcb24b32fca admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.143883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.144885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.145166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.145438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] PATH_INFO: `/v3/projects/207a1d5dbfc34a0f878a6ac493ee4082/users/d1bfd62fc11e4f53bf53013d7cb31a78/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.164266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207a1d5dbfc34a0f878a6ac493ee4082, user_id=d1bfd62fc11e4f53bf53013d7cb31a78, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.167166 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.192042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1288/2581] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:22 2022] PUT /identity/v3/projects/207a1d5dbfc34a0f878a6ac493ee4082/users/d1bfd62fc11e4f53bf53013d7cb31a78/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:41:22.195850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13ca7-c413-4726-a827-9147ae8447ca None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.196224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13ca7-c413-4726-a827-9147ae8447ca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.196505 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b13ca7-c413-4726-a827-9147ae8447ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.229409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-66b13ca7-c413-4726-a827-9147ae8447ca None None] MFA Rules not processed for user `d1bfd62fc11e4f53bf53013d7cb31a78`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:22.230656 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66b13ca7-c413-4726-a827-9147ae8447ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:22.311824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1294/2582] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:22.316384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.393777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677340d-cd13-48b0-b5fe-dc9d0e53ffd3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.398653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.399354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.399635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.399966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.400774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.402724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.435702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1289/2583] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:22 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:22.439478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b13ca7-c413-4726-a827-9147ae8447ca None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.453223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b13ca7-c413-4726-a827-9147ae8447ca None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.465629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:22.532989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.536381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.536381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.536381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.536381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.537095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.560685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1295/2584] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:22 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:22.565026 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.578940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da110e74-eeda-452a-ae01-5d1ad245f5d8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.583606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.584319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.584598 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.584918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.585658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.587374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.603606 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1290/2585] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:22.607891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.621983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cba6ec-090f-42b7-92b1-44f42d9eeeec admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.627071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.628074 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.628482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.628860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] PATH_INFO: `/v3/projects/86d931f1ed6d4c7b8063df732c2550ef/users/729b77052f99476ca860ee855913f38a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.647783 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d931f1ed6d4c7b8063df732c2550ef, user_id=729b77052f99476ca860ee855913f38a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.650689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.666326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1296/2586] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:22 2022] PUT /identity/v3/projects/86d931f1ed6d4c7b8063df732c2550ef/users/729b77052f99476ca860ee855913f38a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:41:22.670596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.681716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c42586-c451-418f-9b26-5e8e54d7cc56 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.703683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:22.745204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baddf61-2965-4332-b59d-b500274226ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.746211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baddf61-2965-4332-b59d-b500274226ad admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.746494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baddf61-2965-4332-b59d-b500274226ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.746799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baddf61-2965-4332-b59d-b500274226ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.747537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baddf61-2965-4332-b59d-b500274226ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.749212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baddf61-2965-4332-b59d-b500274226ad admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.760207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1291/2587] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:41:22.764615 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.776327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86804-944e-49e8-8b57-e0f9cd768e84 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:22.781087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:22.782001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.782287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.782718 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] PATH_INFO: `/v3/projects/86d931f1ed6d4c7b8063df732c2550ef/users/729b77052f99476ca860ee855913f38a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.784779 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d931f1ed6d4c7b8063df732c2550ef, user_id=729b77052f99476ca860ee855913f38a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:22.787475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:22.799055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1297/2588] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:22 2022] PUT /identity/v3/projects/86d931f1ed6d4c7b8063df732c2550ef/users/729b77052f99476ca860ee855913f38a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:22.809550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240325-d49a-4ee9-926b-0a5856e918c7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:22.809839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240325-d49a-4ee9-926b-0a5856e918c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:22.810116 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240325-d49a-4ee9-926b-0a5856e918c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:22.840279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c1240325-d49a-4ee9-926b-0a5856e918c7 None None] MFA Rules not processed for user `729b77052f99476ca860ee855913f38a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:22.841611 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c1240325-d49a-4ee9-926b-0a5856e918c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:22.932066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1292/2589] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:22.943568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:22.945345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:23.011279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61307daa-967d-404e-b936-8113a23db4bf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:23.015744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956d3f0-1f1f-4ab4-a1d5-2ef57f35ef87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:23.016767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d3f0-1f1f-4ab4-a1d5-2ef57f35ef87 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:23.017206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d3f0-1f1f-4ab4-a1d5-2ef57f35ef87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:23.017757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d3f0-1f1f-4ab4-a1d5-2ef57f35ef87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:23.030389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956d3f0-1f1f-4ab4-a1d5-2ef57f35ef87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:23.032157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956d3f0-1f1f-4ab4-a1d5-2ef57f35ef87 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:23.043890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1298/2590] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:23.117204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240325-d49a-4ee9-926b-0a5856e918c7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:23.200162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240325-d49a-4ee9-926b-0a5856e918c7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:23.205231 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:23.206526 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:23.206809 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:23.207087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] PATH_INFO: `/v3/users/d1bfd62fc11e4f53bf53013d7cb31a78` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:23.210510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bfd62fc11e4f53bf53013d7cb31a78)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:23.212527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:23.267322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bfd62fc11e4f53bf53013d7cb31a78'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.267964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bfd62fc11e4f53bf53013d7cb31a78'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.268568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bfd62fc11e4f53bf53013d7cb31a78'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.270432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:23.278446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bfd62fc11e4f53bf53013d7cb31a78'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.292446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bfd62fc11e4f53bf53013d7cb31a78'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.305734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1293/2591] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:41:23 2022] DELETE /identity/v3/users/d1bfd62fc11e4f53bf53013d7cb31a78 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:23.310425 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce848e-f8b4-4f65-80cd-b17133c7a94e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:23.310913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce848e-f8b4-4f65-80cd-b17133c7a94e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:23.311018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce848e-f8b4-4f65-80cd-b17133c7a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:23.330523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f3ce848e-f8b4-4f65-80cd-b17133c7a94e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:23.331838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f3ce848e-f8b4-4f65-80cd-b17133c7a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:23.404673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1299/2592] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:41:23.414342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:23.415884 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:23.476442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20a93-888c-40b5-b497-d3e0a0550450 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:23.480149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:23.480829 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:23.481108 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:23.481379 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:23.490682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:23.492452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:23.503238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1294/2593] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:23.534584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0fdc-9eef-40e4-8d1f-d8fce0569c96 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:23.534951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0fdc-9eef-40e4-8d1f-d8fce0569c96 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:23.535398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0fdc-9eef-40e4-8d1f-d8fce0569c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:23.554311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1ffb0fdc-9eef-40e4-8d1f-d8fce0569c96 None None] MFA Rules not processed for user `f725498599d84b3782c0e0d46131463a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:23.555991 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1ffb0fdc-9eef-40e4-8d1f-d8fce0569c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:23.561900 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:23.619184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1300/2594] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:23.784544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:23.786033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:23.798937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5ee85-f2a0-4062-a5fb-c95dcafd9cea service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:23.804086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:23.804999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:23.805336 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:23.805552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] PATH_INFO: `/v3/projects/207a1d5dbfc34a0f878a6ac493ee4082` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:23.806738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207a1d5dbfc34a0f878a6ac493ee4082)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:23.808601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:23.859576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207a1d5dbfc34a0f878a6ac493ee4082', 'request_id': 'req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.865246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207a1d5dbfc34a0f878a6ac493ee4082', 'request_id': 'req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.872053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207a1d5dbfc34a0f878a6ac493ee4082', 'request_id': 'req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.885501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] The token cache is being invalidate because project 207a1d5dbfc34a0f878a6ac493ee4082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:23.885784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.886404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:23.888239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1295/2595] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:23 2022] DELETE /identity/v3/projects/207a1d5dbfc34a0f878a6ac493ee4082 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:23.892135 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb0fdc-9eef-40e4-8d1f-d8fce0569c96 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:23.903936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb0fdc-9eef-40e4-8d1f-d8fce0569c96 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:23.960399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:23.961324 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:23.961634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:23.961907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] PATH_INFO: `/v3/users/729b77052f99476ca860ee855913f38a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:23.963112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=729b77052f99476ca860ee855913f38a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:23.965124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:24.014037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729b77052f99476ca860ee855913f38a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.014706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729b77052f99476ca860ee855913f38a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.025164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729b77052f99476ca860ee855913f38a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.040513 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729b77052f99476ca860ee855913f38a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.048232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-55147a30-47af-4af1-b789-35e494d32bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729b77052f99476ca860ee855913f38a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.054255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1301/2596] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:41:23 2022] DELETE /identity/v3/users/729b77052f99476ca860ee855913f38a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:24.380078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:24.381532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:24.405109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7882eb8-94c3-4fd5-8ba4-95899bfebac9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:24.459018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:24.472515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:24.473464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.473984 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.474612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] PATH_INFO: `/v3/projects/86d931f1ed6d4c7b8063df732c2550ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.475941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d931f1ed6d4c7b8063df732c2550ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:24.478049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:24.535128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d931f1ed6d4c7b8063df732c2550ef', 'request_id': 'req-e5521ae3-bd16-4c6a-8610-f381393aa071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.541342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d931f1ed6d4c7b8063df732c2550ef', 'request_id': 'req-e5521ae3-bd16-4c6a-8610-f381393aa071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.548030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d931f1ed6d4c7b8063df732c2550ef', 'request_id': 'req-e5521ae3-bd16-4c6a-8610-f381393aa071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.562392 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] The token cache is being invalidate because project 86d931f1ed6d4c7b8063df732c2550ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:24.562756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.563427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e5521ae3-bd16-4c6a-8610-f381393aa071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:24.565262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1296/2597] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:24 2022] DELETE /identity/v3/projects/86d931f1ed6d4c7b8063df732c2550ef => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:24.570351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ffbb-04d3-4dbd-9c2f-3e2e9a890087 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.570806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ffbb-04d3-4dbd-9c2f-3e2e9a890087 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.571161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ffbb-04d3-4dbd-9c2f-3e2e9a890087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.589880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-24d3ffbb-04d3-4dbd-9c2f-3e2e9a890087 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:24.591169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24d3ffbb-04d3-4dbd-9c2f-3e2e9a890087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:24.624051 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:24.656961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1302/2598] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:24.664570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9eadf-019f-4a9a-a316-fa537c299668 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.664935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9eadf-019f-4a9a-a316-fa537c299668 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.665212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9eadf-019f-4a9a-a316-fa537c299668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.687093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f8a9eadf-019f-4a9a-a316-fa537c299668 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:24.688515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f8a9eadf-019f-4a9a-a316-fa537c299668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:24.698122 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1297/2599] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:24.702182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3ffbb-04d3-4dbd-9c2f-3e2e9a890087 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:24.713381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3ffbb-04d3-4dbd-9c2f-3e2e9a890087 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:24.718187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:24.718855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.719143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.719405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.720140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:41:24.720441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:24.722125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:24.735737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1303/2600] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:41:24.740209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9eadf-019f-4a9a-a316-fa537c299668 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:24.752137 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9eadf-019f-4a9a-a316-fa537c299668 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:24.757430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:24.758085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.758362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.758661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.759362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:24.761282 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:24.789885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1298/2601] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:24 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:24.795802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:24.808942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb15779-df22-4ac7-bb46-31e1e8e6136e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:24.869539 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:24.870217 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.870493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.870763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.871458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:24.873448 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:24.896683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1304/2602] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:24 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:24.897899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:24.908159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d9e7-6b59-4758-abf5-0e414724ff5f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:24.912858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:24.913509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.913781 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.914052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.914792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:24.916376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:24.926894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1299/2603] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:24.931263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:24.941509 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571e262-49fc-4378-8b81-7cde5848da91 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:24.947023 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a25d79-3930-4a0b-bed7-160ef41f6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:24.947708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a25d79-3930-4a0b-bed7-160ef41f6cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.947988 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a25d79-3930-4a0b-bed7-160ef41f6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.948259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a25d79-3930-4a0b-bed7-160ef41f6cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.949024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a25d79-3930-4a0b-bed7-160ef41f6cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:24.951354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a25d79-3930-4a0b-bed7-160ef41f6cdd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:24.961283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1305/2604] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:24.965550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:24.975508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ee2d-597a-44d1-bd14-4c5b450d4b37 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:24.980997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:24.981867 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:24.982143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:24.982403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] PATH_INFO: `/v3/projects/be70b13cdee34991a83fddd5e08ecdd9/users/c748f16686a04750882094dbcd5839e5/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:24.998693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be70b13cdee34991a83fddd5e08ecdd9, user_id=c748f16686a04750882094dbcd5839e5, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.001372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.018481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1300/2605] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:24 2022] PUT /identity/v3/projects/be70b13cdee34991a83fddd5e08ecdd9/users/c748f16686a04750882094dbcd5839e5/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:25.029753 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579cfdd-5e9d-46cd-a630-8ebf864e6c05 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.030042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579cfdd-5e9d-46cd-a630-8ebf864e6c05 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.030310 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579cfdd-5e9d-46cd-a630-8ebf864e6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.058055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4579cfdd-5e9d-46cd-a630-8ebf864e6c05 None None] MFA Rules not processed for user `c748f16686a04750882094dbcd5839e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:25.059262 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4579cfdd-5e9d-46cd-a630-8ebf864e6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:25.127302 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1306/2606] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:25.133485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.201695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe55f2-cd87-4f42-81e3-aae82f3bea5f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.207253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.207957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.208239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.208515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.209265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.211211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.239692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1301/2607] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:25 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:41:25.244296 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579cfdd-5e9d-46cd-a630-8ebf864e6c05 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.255741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579cfdd-5e9d-46cd-a630-8ebf864e6c05 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.289993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:25.320334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.330831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.331727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.332607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.334230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.336995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.363994 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1307/2608] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:25 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:25.368211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.374307 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:25.380464 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187702c-58a0-4f46-8529-928ce66b9dfd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.386650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.387520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.388011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.388735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.390299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.391716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.407906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1302/2609] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:25.409118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.419534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325a57-46ec-4b08-940a-8eb64178ed1b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.424280 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a984d6-c6de-496a-8ec4-732720b789c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.424978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a984d6-c6de-496a-8ec4-732720b789c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.425272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a984d6-c6de-496a-8ec4-732720b789c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.425527 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a984d6-c6de-496a-8ec4-732720b789c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.426258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a984d6-c6de-496a-8ec4-732720b789c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.427908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a984d6-c6de-496a-8ec4-732720b789c1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.439577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1308/2610] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:25.443330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.453608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e644-b87d-4e45-b06d-d0d9c882dff0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.458893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.459935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.460315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.460633 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] PATH_INFO: `/v3/projects/0c69abf879d147e7904f02a0252deed4/users/6bc05a6c405e4a9a883fda58d3f0077f/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.477885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c69abf879d147e7904f02a0252deed4, user_id=6bc05a6c405e4a9a883fda58d3f0077f, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.481329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.502870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1303/2611] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:25 2022] PUT /identity/v3/projects/0c69abf879d147e7904f02a0252deed4/users/6bc05a6c405e4a9a883fda58d3f0077f/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:25.513291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326b83-4149-4a78-8f5b-a322f1217576 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.513690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326b83-4149-4a78-8f5b-a322f1217576 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.513854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326b83-4149-4a78-8f5b-a322f1217576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.559169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-07326b83-4149-4a78-8f5b-a322f1217576 None None] MFA Rules not processed for user `6bc05a6c405e4a9a883fda58d3f0077f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:25.560444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-07326b83-4149-4a78-8f5b-a322f1217576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:25.646445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1309/2612] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:25.648543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.676703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.677061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.677773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.696676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:25.698477 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:25.726912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d47743-db11-47a0-b6b5-966accd34c49 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.732623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.733655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.733931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.734203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.734901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.737019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.756372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1310/2613] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:41:25.773060 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1304/2614] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:25 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:41:25.773289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.773289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:25.773889 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.823465 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:25.846994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e0453-12ed-4b50-a89a-175583803315 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.849738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b783e72-b4c4-4862-9f72-b8200dd21784 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.852057 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.852803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.853080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.853438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.854048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.855990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.881698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1305/2615] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:25 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:41:25.882701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.894092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7d364-0d81-40a8-b3fa-fa73f97743a1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.899946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.900623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.900938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.901212 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.901941 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.903558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.917759 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1306/2616] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:41:25.918870 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.922311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.923000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.923285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.923554 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.930174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404975-b6d5-42b2-a8d4-d6dd58638f8d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:25.935237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:25.936232 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:25.936617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:25.936901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] PATH_INFO: `/v3/projects/e981c71fa8434bd9b06ce943959495f8/users/cc960aefebd647039a2d944dd9e4a35c/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:25.954790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e981c71fa8434bd9b06ce943959495f8, user_id=cc960aefebd647039a2d944dd9e4a35c, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.957817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.973538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1307/2617] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:25 2022] PUT /identity/v3/projects/e981c71fa8434bd9b06ce943959495f8/users/cc960aefebd647039a2d944dd9e4a35c/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:25.977442 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:25.987242 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:25.987514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:25.989538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:25.999941 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1311/2618] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:41:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 12:41:26.054576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8758d8-8583-44e7-96ec-86f4321c6e5a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:26.060362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e94be8-d839-4bc1-bc21-95e23fb657e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:26.061253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e94be8-d839-4bc1-bc21-95e23fb657e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:26.061631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e94be8-d839-4bc1-bc21-95e23fb657e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:26.062005 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e94be8-d839-4bc1-bc21-95e23fb657e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:26.062838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e94be8-d839-4bc1-bc21-95e23fb657e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:26.064665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e94be8-d839-4bc1-bc21-95e23fb657e0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:26.077143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1308/2619] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:41:26.083337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:26.098925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfbd7-f0d6-4c27-8aea-da558f9121b3 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:26.104273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:26.105628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:26.106218 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:26.106662 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] PATH_INFO: `/v3/projects/e981c71fa8434bd9b06ce943959495f8/users/cc960aefebd647039a2d944dd9e4a35c/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:26.109093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e981c71fa8434bd9b06ce943959495f8, user_id=cc960aefebd647039a2d944dd9e4a35c, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:26.113909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:26.134144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1312/2620] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:26 2022] PUT /identity/v3/projects/e981c71fa8434bd9b06ce943959495f8/users/cc960aefebd647039a2d944dd9e4a35c/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:26.249402 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:26.250054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:26.250254 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:26.302154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] MFA Rules not processed for user `cc960aefebd647039a2d944dd9e4a35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:26.303592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:26.436850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1309/2621] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:26.451964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:26.454367 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:26.588088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326f879-4169-4c8d-b362-e2e38ddd806a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:26.592948 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:26.593713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:26.594048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:26.594403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:26.607308 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:26.610237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:26.624913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1313/2622] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:27.272846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:27.274339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:27.286369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7056d0c-4059-48bf-8e6b-259807e17d22 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:27.289851 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:27.290488 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:27.290762 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:27.291030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:27.356803 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:27.358501 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:27.370938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1310/2623] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:31.453503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:31.462119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444098-d9f1-4067-b048-3422830da80b service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:31.465756 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28a0c2-1132-4be7-95b6-f3f7c7d0b260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:31.466384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a0c2-1132-4be7-95b6-f3f7c7d0b260 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:31.466663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a0c2-1132-4be7-95b6-f3f7c7d0b260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:31.466934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a0c2-1132-4be7-95b6-f3f7c7d0b260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:31.479440 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:31.528471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28a0c2-1132-4be7-95b6-f3f7c7d0b260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:31.530272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28a0c2-1132-4be7-95b6-f3f7c7d0b260 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:31.547159 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1314/2624] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:33.825250 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:33.856833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:33.894043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc323-c368-4b77-9f9f-e6f9035b8451 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:33.901527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:33.902437 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:33.903002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:33.903002 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] PATH_INFO: `/v3/users/c748f16686a04750882094dbcd5839e5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:33.904244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c748f16686a04750882094dbcd5839e5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:33.906223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:33.982427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c748f16686a04750882094dbcd5839e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:33.983087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c748f16686a04750882094dbcd5839e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:33.983682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c748f16686a04750882094dbcd5839e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:33.992292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c748f16686a04750882094dbcd5839e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.012349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c748f16686a04750882094dbcd5839e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.023354 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1311/2625] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:41:33 2022] DELETE /identity/v3/users/c748f16686a04750882094dbcd5839e5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:34.025520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:34.026128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:34.026128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:34.063329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:34.064701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:34.184224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1315/2626] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:34.194217 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:34.195623 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:34.296715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e204-54e5-4fae-8a8c-6c4719e158fc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:34.300479 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:34.301168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:34.301450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:34.301724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:34.311213 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:34.312784 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:34.322667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1312/2627] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:34.636224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:34.642467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:34.655457 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91548b-cd8a-45ba-8fe3-cfd6bf6b9426 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:34.661700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:34.662686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:34.663073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:34.663635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] PATH_INFO: `/v3/projects/be70b13cdee34991a83fddd5e08ecdd9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:34.664839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be70b13cdee34991a83fddd5e08ecdd9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:34.666784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:34.720229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be70b13cdee34991a83fddd5e08ecdd9', 'request_id': 'req-66cfb58e-02e1-4636-abf1-41cf4910e4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.726862 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be70b13cdee34991a83fddd5e08ecdd9', 'request_id': 'req-66cfb58e-02e1-4636-abf1-41cf4910e4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.733761 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be70b13cdee34991a83fddd5e08ecdd9', 'request_id': 'req-66cfb58e-02e1-4636-abf1-41cf4910e4a8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.759292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] The token cache is being invalidate because project be70b13cdee34991a83fddd5e08ecdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:34.759731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.760723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.763271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1316/2628] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:34 2022] DELETE /identity/v3/projects/be70b13cdee34991a83fddd5e08ecdd9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:34.767308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:34.779303 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46316602-4d46-43cf-b303-c2bc791869e1 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:34.825361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:34.843938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:34.845148 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:34.845499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:34.845901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] PATH_INFO: `/v3/users/6bc05a6c405e4a9a883fda58d3f0077f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:34.847783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc05a6c405e4a9a883fda58d3f0077f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:34.849906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:34.917737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc05a6c405e4a9a883fda58d3f0077f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.918814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc05a6c405e4a9a883fda58d3f0077f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.919640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc05a6c405e4a9a883fda58d3f0077f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.930698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc05a6c405e4a9a883fda58d3f0077f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.943105 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc05a6c405e4a9a883fda58d3f0077f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:34.955836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1313/2629] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:41:34 2022] DELETE /identity/v3/users/6bc05a6c405e4a9a883fda58d3f0077f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:41:35.369144 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:35.371372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:35.390042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb58e-02e1-4636-abf1-41cf4910e4a8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:35.429474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:35.448463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:35.449357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:35.449639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:35.449906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] PATH_INFO: `/v3/projects/0c69abf879d147e7904f02a0252deed4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:35.451127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c69abf879d147e7904f02a0252deed4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:35.453068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:35.501784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c69abf879d147e7904f02a0252deed4', 'request_id': 'req-0db3819a-f884-4e65-b1a0-594629a3ac29'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.507186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c69abf879d147e7904f02a0252deed4', 'request_id': 'req-0db3819a-f884-4e65-b1a0-594629a3ac29'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.513416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c69abf879d147e7904f02a0252deed4', 'request_id': 'req-0db3819a-f884-4e65-b1a0-594629a3ac29'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.528092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] The token cache is being invalidate because project 0c69abf879d147e7904f02a0252deed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:35.528379 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.529094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.530872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1317/2630] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:35 2022] DELETE /identity/v3/projects/0c69abf879d147e7904f02a0252deed4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:35.534917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:35.536361 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:35.549124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23308e0a-7b95-4b91-a282-9d3e3cf39eb8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:35.611904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:35.612828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:35.613110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:35.613384 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] PATH_INFO: `/v3/users/cc960aefebd647039a2d944dd9e4a35c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:35.614627 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc960aefebd647039a2d944dd9e4a35c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:35.616691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:35.674919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc960aefebd647039a2d944dd9e4a35c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.675566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc960aefebd647039a2d944dd9e4a35c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.676156 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc960aefebd647039a2d944dd9e4a35c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.685031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc960aefebd647039a2d944dd9e4a35c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.696678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:35.697947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9de487d6-0a7e-451b-be83-86340dd30f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc960aefebd647039a2d944dd9e4a35c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:35.711385 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1314/2631] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:41:35 2022] DELETE /identity/v3/users/cc960aefebd647039a2d944dd9e4a35c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:36.012179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.013303 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:36.035208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3819a-f884-4e65-b1a0-594629a3ac29 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.100744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.101609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.101915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.102186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] PATH_INFO: `/v3/projects/e981c71fa8434bd9b06ce943959495f8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.103431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e981c71fa8434bd9b06ce943959495f8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.105398 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.153529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e981c71fa8434bd9b06ce943959495f8', 'request_id': 'req-e6516205-1405-4fde-acb0-6d47bc1b4cfc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:36.159424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e981c71fa8434bd9b06ce943959495f8', 'request_id': 'req-e6516205-1405-4fde-acb0-6d47bc1b4cfc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:36.165970 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e981c71fa8434bd9b06ce943959495f8', 'request_id': 'req-e6516205-1405-4fde-acb0-6d47bc1b4cfc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:36.179031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:36.183434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] The token cache is being invalidate because project e981c71fa8434bd9b06ce943959495f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:41:36.184058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:36.184797 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6516205-1405-4fde-acb0-6d47bc1b4cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:41:36.186393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1318/2632] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:41:36 2022] DELETE /identity/v3/projects/e981c71fa8434bd9b06ce943959495f8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:36.193936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeecf6-aa40-47e9-9805-682d5c94742a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.194667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeecf6-aa40-47e9-9805-682d5c94742a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.194667 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbeecf6-aa40-47e9-9805-682d5c94742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.222097 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8fbeecf6-aa40-47e9-9805-682d5c94742a None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:36.223857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8fbeecf6-aa40-47e9-9805-682d5c94742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:36.299107 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1315/2633] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:41:36.307341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26905-fb65-4df0-bd2a-abc954620bbe None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.307600 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26905-fb65-4df0-bd2a-abc954620bbe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.307888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26905-fb65-4df0-bd2a-abc954620bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.327276 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-73b26905-fb65-4df0-bd2a-abc954620bbe None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:36.328423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-73b26905-fb65-4df0-bd2a-abc954620bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:36.337438 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1319/2634] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:36.341728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeecf6-aa40-47e9-9805-682d5c94742a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.352964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbeecf6-aa40-47e9-9805-682d5c94742a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.359891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.360571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.360885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.361368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.362236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:41:36.362546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.364460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.378850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1316/2635] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:41:36.383227 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26905-fb65-4df0-bd2a-abc954620bbe None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.396775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26905-fb65-4df0-bd2a-abc954620bbe None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.401815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.402492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.402771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.404146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.404886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.406992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.439607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1320/2636] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:41:36 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:41:36.440853 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.451239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32be702-29a9-426f-899e-afadc96a2126 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.510267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.510942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.511214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.511484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.512174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.514118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.536193 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1317/2637] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:41:36 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:41:36.540478 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.550584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7dd2b-8609-4af8-b4c9-5dc563a56075 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.555095 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.555884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.556166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.556433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.557189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.558842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.569374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1321/2638] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:36.573729 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.584163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12327cda-3e16-4d32-a03f-8e8e89ed9cb2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.588929 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace14d-07e8-47ff-a671-010a48ce09a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.589580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace14d-07e8-47ff-a671-010a48ce09a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.589861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace14d-07e8-47ff-a671-010a48ce09a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.590135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace14d-07e8-47ff-a671-010a48ce09a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.590861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ace14d-07e8-47ff-a671-010a48ce09a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.592457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ace14d-07e8-47ff-a671-010a48ce09a2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.603376 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1318/2639] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:41:36.607787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.618588 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5289-7944-4269-8590-a89616dd97e4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.627080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.628385 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.628667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.629059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] PATH_INFO: `/v3/projects/97853d28d0b440e09c6915c0009b781f/users/4c23a19e19374fdb85aa3fc20a4c4df6/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.647104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=97853d28d0b440e09c6915c0009b781f, user_id=4c23a19e19374fdb85aa3fc20a4c4df6, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.649868 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.665717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1322/2640] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:41:36 2022] PUT /identity/v3/projects/97853d28d0b440e09c6915c0009b781f/users/4c23a19e19374fdb85aa3fc20a4c4df6/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:41:36.677027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.677312 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.677594 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.706629 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] MFA Rules not processed for user `4c23a19e19374fdb85aa3fc20a4c4df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:41:36.707835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:36.751945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:36.786338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1319/2641] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:41:36.798197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:36.800256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:36.861168 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5530d-7a59-4983-84ec-8ecc6d6da9eb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:36.865347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1470011d984f45be788072525f82cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:36.865981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:36.866255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:36.866528 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:36.875747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:36.877196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:36.886178 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1323/2642] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:46.780995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:46.882081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:50.886406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:50.888092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:50.982496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719534-eda6-4a23-95d0-38567f533d7f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:50.986176 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:50.986813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:50.987093 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:50.987364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:50.989432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:51.001921 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:51.003506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:51.012022 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1320/2643] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:41:56.310633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:41:56.312300 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:56.325803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f7f9-7ee5-429d-a618-75f80962cd4a service glance] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:41:56.329796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06bca5-9705-4455-a549-e686fca085fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:41:56.330433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06bca5-9705-4455-a549-e686fca085fa service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:41:56.330717 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06bca5-9705-4455-a549-e686fca085fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:41:56.330989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06bca5-9705-4455-a549-e686fca085fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:41:56.332852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1b06bca5-9705-4455-a549-e686fca085fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:41:56.398682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06bca5-9705-4455-a549-e686fca085fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:41:56.400332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06bca5-9705-4455-a549-e686fca085fa service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:41:56.410335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1324/2644] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:41:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:01.008461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=39 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:06.406333 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=30 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:06.915896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:06.983001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb0915-7aba-4720-96fa-cdbbd71a97ff service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:06.987988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:06.988874 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:06.989151 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:06.989430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] PATH_INFO: `/v3/users/4c23a19e19374fdb85aa3fc20a4c4df6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:06.990644 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c23a19e19374fdb85aa3fc20a4c4df6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:06.992993 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:07.043298 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c23a19e19374fdb85aa3fc20a4c4df6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.043972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c23a19e19374fdb85aa3fc20a4c4df6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.044587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c23a19e19374fdb85aa3fc20a4c4df6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.052968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c23a19e19374fdb85aa3fc20a4c4df6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.064896 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c23a19e19374fdb85aa3fc20a4c4df6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.076994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1321/2645] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:42:06 2022] DELETE /identity/v3/users/4c23a19e19374fdb85aa3fc20a4c4df6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:07.081610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:07.081895 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:07.082163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:07.100253 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:07.101493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:07.162736 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1325/2646] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:07.172550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:07.174103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:07.235802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab631b-f68e-4e46-96c1-0073632b4288 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:07.239603 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a4f4-9eb4-496e-b124-3134a48d7691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:07.240249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a4f4-9eb4-496e-b124-3134a48d7691 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:07.240532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a4f4-9eb4-496e-b124-3134a48d7691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:07.240860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a4f4-9eb4-496e-b124-3134a48d7691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:07.251638 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a4f4-9eb4-496e-b124-3134a48d7691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:07.253143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a4f4-9eb4-496e-b124-3134a48d7691 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:07.262790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1322/2647] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:07.538045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:07.539501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:07.551966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886ffa5-440f-4a3f-9002-21cafe7543e8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:07.558430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:07.559599 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:07.559852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:07.560128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] PATH_INFO: `/v3/projects/97853d28d0b440e09c6915c0009b781f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:07.561791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=97853d28d0b440e09c6915c0009b781f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:07.563816 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:07.614077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97853d28d0b440e09c6915c0009b781f', 'request_id': 'req-2dc87776-54d8-4146-8780-8dd3682423dd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.620767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97853d28d0b440e09c6915c0009b781f', 'request_id': 'req-2dc87776-54d8-4146-8780-8dd3682423dd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.627164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97853d28d0b440e09c6915c0009b781f', 'request_id': 'req-2dc87776-54d8-4146-8780-8dd3682423dd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.641906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] The token cache is being invalidate because project 97853d28d0b440e09c6915c0009b781f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:07.642186 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.642807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:07.644347 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1326/2648] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:07 2022] DELETE /identity/v3/projects/97853d28d0b440e09c6915c0009b781f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:17.258449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:17.638852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:22.157966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:22.158421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:22.158538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:22.177299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] MFA Rules not processed for user `1aad8b1af5994d7b9de3a8fb0be556cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:22.178505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:22.239073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1323/2649] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:32.232078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=25 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:32.333871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:32.335519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:32.395635 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc87776-54d8-4146-8780-8dd3682423dd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:32.399593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:32.400233 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:32.400508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:32.400800 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:32.402648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:32.491340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:32.493102 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:32.518495 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1327/2650] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:36.814959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:36.817613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:36.833014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7378-67bc-46c6-a295-ad47ab002956 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:36.838324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:36.840128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:36.840587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:36.840940 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] PATH_INFO: `/v3/users/eefde2311ec64430a6ed161238024df4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:36.856425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eefde2311ec64430a6ed161238024df4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:36.858778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:36.918070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eefde2311ec64430a6ed161238024df4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:36.918817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eefde2311ec64430a6ed161238024df4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:36.919389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eefde2311ec64430a6ed161238024df4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:36.927524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eefde2311ec64430a6ed161238024df4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:36.940964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4b273c78-ff25-4598-ab9f-72e3cfaad745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eefde2311ec64430a6ed161238024df4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:36.955226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1324/2651] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:42:36 2022] DELETE /identity/v3/users/eefde2311ec64430a6ed161238024df4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:37.142459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.154038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8130c-9f60-44c1-8bf0-069e416a3611 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.225238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.226188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.226586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.226866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] PATH_INFO: `/v3/projects/c7917b551c3c4cc9be8a007b5cc987d3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.228055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7917b551c3c4cc9be8a007b5cc987d3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:37.230014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:37.254556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:37.278094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7917b551c3c4cc9be8a007b5cc987d3', 'request_id': 'req-a983ab3c-0280-461c-8a55-ed39bc6f9067'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:37.283787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7917b551c3c4cc9be8a007b5cc987d3', 'request_id': 'req-a983ab3c-0280-461c-8a55-ed39bc6f9067'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:37.290336 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7917b551c3c4cc9be8a007b5cc987d3', 'request_id': 'req-a983ab3c-0280-461c-8a55-ed39bc6f9067'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:37.303771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] The token cache is being invalidate because project c7917b551c3c4cc9be8a007b5cc987d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:37.304060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:37.304747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a983ab3c-0280-461c-8a55-ed39bc6f9067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:37.306326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1328/2652] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:37 2022] DELETE /identity/v3/projects/c7917b551c3c4cc9be8a007b5cc987d3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:37.311492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72554-6c97-495c-adce-922e877fd57c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.311743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72554-6c97-495c-adce-922e877fd57c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.312023 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72554-6c97-495c-adce-922e877fd57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.330640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b1c72554-6c97-495c-adce-922e877fd57c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:37.331845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b1c72554-6c97-495c-adce-922e877fd57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:37.392919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1325/2653] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:37.400873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de91a0-3f79-4015-8e16-7bd40fe29d01 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.401166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de91a0-3f79-4015-8e16-7bd40fe29d01 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.401447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de91a0-3f79-4015-8e16-7bd40fe29d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.423683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-43de91a0-3f79-4015-8e16-7bd40fe29d01 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:37.424942 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-43de91a0-3f79-4015-8e16-7bd40fe29d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:37.433164 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1329/2654] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:37.438810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c72554-6c97-495c-adce-922e877fd57c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.450181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c72554-6c97-495c-adce-922e877fd57c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.455424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.456053 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.456352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.456601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.457362 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:42:37.457668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:37.459269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:37.471127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1326/2655] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:42:37.475430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de91a0-3f79-4015-8e16-7bd40fe29d01 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.485031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de91a0-3f79-4015-8e16-7bd40fe29d01 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.490427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.491078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.491354 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.491628 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.492682 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:37.494636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:37.521964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1330/2656] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:37 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:37.528253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.542621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040b6aa-4dc1-4624-8a17-296451fe699e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.590562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:37.604394 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.605084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.605364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.605639 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.606342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:37.608289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:37.633933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1327/2657] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:42:37 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:37.638189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.648606 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b52f4-4965-43cb-8086-39cd258fdf23 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.653376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.654026 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.654299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.654568 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.655288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:37.656978 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:37.667418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1331/2658] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:37.671562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.682710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5775e47-84a7-445b-b9e7-7b756f998955 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.688513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078db4c-5dde-4966-a95c-96037cf2fff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.689194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078db4c-5dde-4966-a95c-96037cf2fff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.689473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078db4c-5dde-4966-a95c-96037cf2fff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.689737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078db4c-5dde-4966-a95c-96037cf2fff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.690468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078db4c-5dde-4966-a95c-96037cf2fff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:37.692059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078db4c-5dde-4966-a95c-96037cf2fff2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:37.702513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1328/2659] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:37.706750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.717684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9ae28-459b-431a-8b12-aa8f4b1de2f6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.724058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.724971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.725246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.725514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] PATH_INFO: `/v3/projects/58194a397ea646629fe8e4a725dea646/users/b127a82a988d4eddb9840303ac092003/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.745266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58194a397ea646629fe8e4a725dea646, user_id=b127a82a988d4eddb9840303ac092003, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:37.747838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:37.766415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1332/2660] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:37 2022] PUT /identity/v3/projects/58194a397ea646629fe8e4a725dea646/users/b127a82a988d4eddb9840303ac092003/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:37.780088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d74e-1369-4911-af7b-256fe27377d0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.780377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d74e-1369-4911-af7b-256fe27377d0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.780676 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d74e-1369-4911-af7b-256fe27377d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:37.809534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1ef6d74e-1369-4911-af7b-256fe27377d0 None None] MFA Rules not processed for user `b127a82a988d4eddb9840303ac092003`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:37.810750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1ef6d74e-1369-4911-af7b-256fe27377d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:37.879811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1329/2661] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:42:37.892224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:37.894287 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:37.987546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32e6fb-d059-4568-9eec-9f799520a6d9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:37.994040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a341b1c-74f2-465f-bc32-8d0c583253ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:37.994678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341b1c-74f2-465f-bc32-8d0c583253ed service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:37.994966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341b1c-74f2-465f-bc32-8d0c583253ed service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:37.995229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341b1c-74f2-465f-bc32-8d0c583253ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:38.003332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a341b1c-74f2-465f-bc32-8d0c583253ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:38.004971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a341b1c-74f2-465f-bc32-8d0c583253ed service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:38.014001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1333/2662] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:38.220613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6d74e-1369-4911-af7b-256fe27377d0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:38.283942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6d74e-1369-4911-af7b-256fe27377d0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:38.288754 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:38.289525 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:38.289806 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:38.290074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] PATH_INFO: `/v3/users/b127a82a988d4eddb9840303ac092003` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:38.291326 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b127a82a988d4eddb9840303ac092003)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:38.293378 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:38.345286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b127a82a988d4eddb9840303ac092003'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.345970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b127a82a988d4eddb9840303ac092003'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.346572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b127a82a988d4eddb9840303ac092003'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.355256 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b127a82a988d4eddb9840303ac092003'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.360270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:38.370827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b127a82a988d4eddb9840303ac092003'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.387859 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1330/2663] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:42:38 2022] DELETE /identity/v3/users/b127a82a988d4eddb9840303ac092003 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:38.393937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:38.394464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:38.394464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:38.413208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:38.414453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:38.427115 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:38.478000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1334/2664] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:38.487740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:38.489305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:38.552242 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e080-f26a-46da-9416-6d826599a4e4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:38.556015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b36d0c-9be9-4d83-8df3-f3d65bf87cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:38.556674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b36d0c-9be9-4d83-8df3-f3d65bf87cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:38.556957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b36d0c-9be9-4d83-8df3-f3d65bf87cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:38.557228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b36d0c-9be9-4d83-8df3-f3d65bf87cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:38.566648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b36d0c-9be9-4d83-8df3-f3d65bf87cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:38.568082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b36d0c-9be9-4d83-8df3-f3d65bf87cc2 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:38.577482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1331/2665] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:38.872027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:38.873575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:38.885760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616b430-cc1e-4b64-aa86-af0a33696a20 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:38.891081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:38.891952 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:38.892229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:38.892499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] PATH_INFO: `/v3/projects/58194a397ea646629fe8e4a725dea646` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:38.893734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58194a397ea646629fe8e4a725dea646)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:38.895672 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:38.944142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58194a397ea646629fe8e4a725dea646', 'request_id': 'req-7dbcb8fc-4f5d-45f3-8470-ec980113739d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.949549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58194a397ea646629fe8e4a725dea646', 'request_id': 'req-7dbcb8fc-4f5d-45f3-8470-ec980113739d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.955640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58194a397ea646629fe8e4a725dea646', 'request_id': 'req-7dbcb8fc-4f5d-45f3-8470-ec980113739d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.969840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] The token cache is being invalidate because project 58194a397ea646629fe8e4a725dea646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:38.970119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.970727 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7dbcb8fc-4f5d-45f3-8470-ec980113739d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:38.972259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1335/2666] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:38 2022] DELETE /identity/v3/projects/58194a397ea646629fe8e4a725dea646 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:38.977612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4e20c-9b75-4fd0-978a-3cc9b39fa8dc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:38.978126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4e20c-9b75-4fd0-978a-3cc9b39fa8dc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:38.978262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4e20c-9b75-4fd0-978a-3cc9b39fa8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:38.996733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-76f4e20c-9b75-4fd0-978a-3cc9b39fa8dc None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:38.997932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-76f4e20c-9b75-4fd0-978a-3cc9b39fa8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:39.056147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1332/2667] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:39.064028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392b44-d7e1-4b89-9985-8105655d18f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.064392 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392b44-d7e1-4b89-9985-8105655d18f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.064678 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392b44-d7e1-4b89-9985-8105655d18f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.086801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e4392b44-d7e1-4b89-9985-8105655d18f1 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:39.087987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e4392b44-d7e1-4b89-9985-8105655d18f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:39.096235 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1336/2668] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:39.102345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4e20c-9b75-4fd0-978a-3cc9b39fa8dc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.112700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4e20c-9b75-4fd0-978a-3cc9b39fa8dc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.119655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.120308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.120585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.120892 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.121625 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:42:39.121930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.123534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.136655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1333/2669] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:42:39.141046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392b44-d7e1-4b89-9985-8105655d18f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.151104 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4392b44-d7e1-4b89-9985-8105655d18f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.157152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.157815 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.158094 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.158361 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.159047 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.161008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.191648 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1337/2670] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:39 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:39.196078 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.206367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181dd79-7396-400f-a02e-7ac3e7568234 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.267264 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.267930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.268206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.268466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.269157 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.271081 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.282143 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:39.295276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1334/2671] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:42:39 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:39.299423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.309856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28070-308b-46c9-9598-851bbb2eb1af admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.314641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.315307 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.315586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.315855 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.316585 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.318232 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.329665 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1338/2672] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:39.333854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.343907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a4fbc-e9c9-49f5-9b4b-bb5d400123b0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.348432 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40289e0e-9cd3-4e55-83fa-8a80a9da4e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.349112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40289e0e-9cd3-4e55-83fa-8a80a9da4e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.349389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40289e0e-9cd3-4e55-83fa-8a80a9da4e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.349657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40289e0e-9cd3-4e55-83fa-8a80a9da4e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.350440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40289e0e-9cd3-4e55-83fa-8a80a9da4e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.352048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40289e0e-9cd3-4e55-83fa-8a80a9da4e1d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.365178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1335/2673] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:42:39.367316 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.377793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2a01a-6e7f-48ad-8393-63b4e39ab53d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.383260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.384150 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.384423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.384715 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] PATH_INFO: `/v3/projects/d41672cae7c7473bbb7c826c8fa4b38d/users/e96162ce0c844634920437ec9da5c653/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.399870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41672cae7c7473bbb7c826c8fa4b38d, user_id=e96162ce0c844634920437ec9da5c653, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.402548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.419021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1339/2674] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:39 2022] PUT /identity/v3/projects/d41672cae7c7473bbb7c826c8fa4b38d/users/e96162ce0c844634920437ec9da5c653/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:39.436206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb0b76-7166-4d43-b4ad-510b09f66efa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.436568 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb0b76-7166-4d43-b4ad-510b09f66efa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.436975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb0b76-7166-4d43-b4ad-510b09f66efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.468037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-caeb0b76-7166-4d43-b4ad-510b09f66efa None None] MFA Rules not processed for user `e96162ce0c844634920437ec9da5c653`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:39.469220 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-caeb0b76-7166-4d43-b4ad-510b09f66efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:39.536365 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1336/2675] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:39.541124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.584681 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:39.607247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46330f92-6290-4f83-a20f-c42b7608bbcc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.612041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.612720 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.613008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.613284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.613968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.615913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.642363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1340/2676] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:39 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:39.646540 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb0b76-7166-4d43-b4ad-510b09f66efa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.657072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb0b76-7166-4d43-b4ad-510b09f66efa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.712791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.713447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.713724 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.713990 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.714659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.716552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.739567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1337/2677] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:42:39 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:39.744480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.761447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1508e-538c-4ac9-b991-38bdb5679602 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.769549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.770474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.770786 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.771140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.772230 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.774148 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.785279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1341/2678] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:39.789683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.800134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa09b-704b-4382-bde1-4e11eaf505e0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.805771 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.806655 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.806932 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.807203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] PATH_INFO: `/v3/projects/ae5e634106374d718766d9c09d9b1b88/users/d5a8d0a7f70c4e8aa4fc48b5bb8c3d49/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.822825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5e634106374d718766d9c09d9b1b88, user_id=d5a8d0a7f70c4e8aa4fc48b5bb8c3d49, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.825555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.840050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1338/2679] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:39 2022] PUT /identity/v3/projects/ae5e634106374d718766d9c09d9b1b88/users/d5a8d0a7f70c4e8aa4fc48b5bb8c3d49/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:39.844191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.854703 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277812a-a808-4d9d-9180-a5518acce79b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.912525 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cac464-0712-421f-a48f-4b8156b92aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.913191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cac464-0712-421f-a48f-4b8156b92aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.913474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cac464-0712-421f-a48f-4b8156b92aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.913763 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cac464-0712-421f-a48f-4b8156b92aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.914487 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cac464-0712-421f-a48f-4b8156b92aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.916107 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cac464-0712-421f-a48f-4b8156b92aa1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.926533 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1342/2680] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:39.930767 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:39.941126 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9c168-fe5e-4bf4-9c48-76be74567e16 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:39.946443 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:39.947368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.947643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.947911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] PATH_INFO: `/v3/projects/ae5e634106374d718766d9c09d9b1b88/users/d5a8d0a7f70c4e8aa4fc48b5bb8c3d49/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:39.950113 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5e634106374d718766d9c09d9b1b88, user_id=d5a8d0a7f70c4e8aa4fc48b5bb8c3d49, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:39.952793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:39.963720 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1339/2681] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:39 2022] PUT /identity/v3/projects/ae5e634106374d718766d9c09d9b1b88/users/d5a8d0a7f70c4e8aa4fc48b5bb8c3d49/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:39.973982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c88c5-36f5-4308-8e4a-cee36ec64dda None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:39.974267 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c88c5-36f5-4308-8e4a-cee36ec64dda None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:39.974538 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c88c5-36f5-4308-8e4a-cee36ec64dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:40.001847 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fb4c88c5-36f5-4308-8e4a-cee36ec64dda None None] MFA Rules not processed for user `d5a8d0a7f70c4e8aa4fc48b5bb8c3d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:40.002971 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fb4c88c5-36f5-4308-8e4a-cee36ec64dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:40.078157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1343/2682] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:40.091516 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:40.093670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:40.131345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:40.174159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f9773-3096-49de-ba67-db99fd7d690b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:40.178178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:40.178818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:40.179086 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:40.179360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:40.188832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:40.190260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:40.199907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1340/2683] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:40.280589 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c88c5-36f5-4308-8e4a-cee36ec64dda None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:40.291078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c88c5-36f5-4308-8e4a-cee36ec64dda None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:40.295526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:40.296172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:40.296450 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:40.296741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:40.329639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:40.359128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:40.360584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:40.370080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1344/2684] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:41.651165 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:41.652766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:41.712550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f000c6-bc8c-4815-b76c-4aa3148e9a8d service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:41.718201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:41.718900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:41.719218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:41.719558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:41.721668 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:41.817730 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:41.819251 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:41.832138 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1341/2685] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:43.029879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:43.031405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:43.044157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05695577-4c8e-4343-ad2c-ad8c12b79260 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:43.047743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf832e-1bf0-43c8-b03d-39a1274226a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:43.048401 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf832e-1bf0-43c8-b03d-39a1274226a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:43.048739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf832e-1bf0-43c8-b03d-39a1274226a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:43.049122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf832e-1bf0-43c8-b03d-39a1274226a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:43.051123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35cf832e-1bf0-43c8-b03d-39a1274226a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:43.065617 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf832e-1bf0-43c8-b03d-39a1274226a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:43.067098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf832e-1bf0-43c8-b03d-39a1274226a3 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:43.078369 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1345/2686] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:50.626966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:50.676857 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:50.692814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb1f01-dcf6-43ad-8e5c-872fdef5a85d service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:50.697919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:50.698783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:50.699055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:50.699322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] PATH_INFO: `/v3/users/e96162ce0c844634920437ec9da5c653` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:50.700499 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96162ce0c844634920437ec9da5c653)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:50.702425 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:50.751066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96162ce0c844634920437ec9da5c653'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:50.751665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96162ce0c844634920437ec9da5c653'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:50.752297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96162ce0c844634920437ec9da5c653'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:50.761115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96162ce0c844634920437ec9da5c653'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:50.772691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96162ce0c844634920437ec9da5c653'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:50.784355 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1342/2687] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:42:50 2022] DELETE /identity/v3/users/e96162ce0c844634920437ec9da5c653 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:50.789010 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:50.789526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:50.789526 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:50.806974 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:50.808158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:50.872433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1346/2688] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:50.882238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:50.883783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:50.944985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaebbcd-cf55-4193-b0a3-669f48ec5001 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:50.948908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:50.949551 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:50.949827 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:50.950098 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:50.959495 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:50.960950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:50.970322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1343/2689] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:51.254864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:51.256476 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:51.268985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbe974-fe8c-4de0-b693-16d236d0eeba None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:51.274612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:51.275485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:51.275759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:51.276045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] PATH_INFO: `/v3/projects/d41672cae7c7473bbb7c826c8fa4b38d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:51.277434 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41672cae7c7473bbb7c826c8fa4b38d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:51.279459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:51.328221 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41672cae7c7473bbb7c826c8fa4b38d', 'request_id': 'req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.335088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41672cae7c7473bbb7c826c8fa4b38d', 'request_id': 'req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.342657 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41672cae7c7473bbb7c826c8fa4b38d', 'request_id': 'req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.357826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] The token cache is being invalidate because project d41672cae7c7473bbb7c826c8fa4b38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:51.358111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.358743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.360312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1347/2690] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:51 2022] DELETE /identity/v3/projects/d41672cae7c7473bbb7c826c8fa4b38d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:51.364471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:51.374449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995a9a-50f3-4b9e-99dd-1e15f2fa5291 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:51.436237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:51.437169 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:51.437453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:51.437916 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] PATH_INFO: `/v3/users/d5a8d0a7f70c4e8aa4fc48b5bb8c3d49` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:51.439285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a8d0a7f70c4e8aa4fc48b5bb8c3d49)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:51.441555 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:51.455683 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:51.492852 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a8d0a7f70c4e8aa4fc48b5bb8c3d49'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.493496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a8d0a7f70c4e8aa4fc48b5bb8c3d49'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.494079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a8d0a7f70c4e8aa4fc48b5bb8c3d49'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.508259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a8d0a7f70c4e8aa4fc48b5bb8c3d49'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.521543 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0cd7efe-9490-4082-9c20-8297cac9340f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a8d0a7f70c4e8aa4fc48b5bb8c3d49'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:51.540467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1344/2691] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:42:51 2022] DELETE /identity/v3/users/d5a8d0a7f70c4e8aa4fc48b5bb8c3d49 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:52.209737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:52.211203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:52.224828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54a73-eb43-4f7e-a952-df6d7d7d97d6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:52.282127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:52.299749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:52.300668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.300965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.301234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] PATH_INFO: `/v3/projects/ae5e634106374d718766d9c09d9b1b88` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.302504 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5e634106374d718766d9c09d9b1b88)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:52.304807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:52.352967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5e634106374d718766d9c09d9b1b88', 'request_id': 'req-8d36c538-8784-4cba-b07a-5ef65e913734'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:52.358343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5e634106374d718766d9c09d9b1b88', 'request_id': 'req-8d36c538-8784-4cba-b07a-5ef65e913734'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:52.364519 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5e634106374d718766d9c09d9b1b88', 'request_id': 'req-8d36c538-8784-4cba-b07a-5ef65e913734'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:52.379770 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] The token cache is being invalidate because project ae5e634106374d718766d9c09d9b1b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:52.380044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:52.380651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d36c538-8784-4cba-b07a-5ef65e913734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:52.382223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1348/2692] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:52 2022] DELETE /identity/v3/projects/ae5e634106374d718766d9c09d9b1b88 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:52.387189 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25266-a056-4dfb-8a2a-7bc134d9af7d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.387706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25266-a056-4dfb-8a2a-7bc134d9af7d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.387706 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25266-a056-4dfb-8a2a-7bc134d9af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.406329 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-01a25266-a056-4dfb-8a2a-7bc134d9af7d None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:52.407532 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-01a25266-a056-4dfb-8a2a-7bc134d9af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:52.478570 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1345/2693] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:52.486445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36087f98-10ec-47e6-9014-52399c6bcb68 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.486738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36087f98-10ec-47e6-9014-52399c6bcb68 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.487013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36087f98-10ec-47e6-9014-52399c6bcb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.508032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-36087f98-10ec-47e6-9014-52399c6bcb68 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:52.509297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-36087f98-10ec-47e6-9014-52399c6bcb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:52.518907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1349/2694] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:52.524952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a25266-a056-4dfb-8a2a-7bc134d9af7d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:52.534895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a25266-a056-4dfb-8a2a-7bc134d9af7d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:52.539818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:52.540453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.540777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.541052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.541787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:42:52.542094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:52.543694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:52.555322 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1346/2695] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:42:52.561370 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36087f98-10ec-47e6-9014-52399c6bcb68 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:52.572834 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36087f98-10ec-47e6-9014-52399c6bcb68 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:52.577858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:52.578512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.578795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.579038 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.579709 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:52.581713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:52.613583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1350/2696] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:52 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:52.619360 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:52.629794 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d20dc-636f-4dcc-adc8-4079bb43cee4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:52.687421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:52.688072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.688352 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.688624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.689331 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:52.691247 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:52.715351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1347/2697] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:42:52 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:52.719668 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:52.730112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ba12-4b2b-4986-a15e-9c02930e2014 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:52.734776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:52.735426 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.735706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.735979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.736745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:52.738346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:52.749366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1351/2698] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:52.753462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:52.763507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f3e88-4b9c-45bc-b769-8f7907bc71a8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:52.768202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daa390-3819-4022-9168-cab75b1d1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:52.768881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa390-3819-4022-9168-cab75b1d1807 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.769159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa390-3819-4022-9168-cab75b1d1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.769426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa390-3819-4022-9168-cab75b1d1807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.770164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daa390-3819-4022-9168-cab75b1d1807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:52.771780 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daa390-3819-4022-9168-cab75b1d1807 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:52.773039 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:52.783977 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1348/2699] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:52.787943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:52.798003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a0761-0e0a-4262-a7c3-dbe14e2d9fed admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:52.803174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:52.804055 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.804331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.804591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] PATH_INFO: `/v3/projects/919bcf4b0dd54d93917aca8e2e964962/users/e261ca7037154660a119cff3374f7a0d/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.819708 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=919bcf4b0dd54d93917aca8e2e964962, user_id=e261ca7037154660a119cff3374f7a0d, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:52.822482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:52.838399 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1352/2700] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:52 2022] PUT /identity/v3/projects/919bcf4b0dd54d93917aca8e2e964962/users/e261ca7037154660a119cff3374f7a0d/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:42:52.849962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e3a1-9791-48af-85f6-8684de5e6b70 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:52.850265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e3a1-9791-48af-85f6-8684de5e6b70 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:52.850548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e3a1-9791-48af-85f6-8684de5e6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:52.887457 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2e23e3a1-9791-48af-85f6-8684de5e6b70 None None] MFA Rules not processed for user `e261ca7037154660a119cff3374f7a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:52.888602 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2e23e3a1-9791-48af-85f6-8684de5e6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:52.974055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1349/2701] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:42:52.979105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.042080 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17dba9-905d-4354-9ba7-6e0bf669a09a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.047823 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.048480 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.048787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.049059 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.049747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.051691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.066026 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:53.081396 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1353/2702] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:52 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:53.085550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e3a1-9791-48af-85f6-8684de5e6b70 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.096332 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e3a1-9791-48af-85f6-8684de5e6b70 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.161563 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.162114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.162409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.162679 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.163367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.165357 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.187534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1350/2703] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:42:53 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:42:53.192248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.204024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af4616-3934-4661-a523-b858d8f62de8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.209493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.210143 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.210747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.210747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.211556 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.213208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.225444 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1354/2704] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:53.229507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.240199 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35a009-8d0b-4fdc-b24f-3b09fc10d32a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.248226 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.249276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.249554 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.249823 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] PATH_INFO: `/v3/projects/c9d1fcd9365847dbbcdc352fa543ae45/users/30fecfd55909439d921b0ed8c91d87fd/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.269349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d1fcd9365847dbbcdc352fa543ae45, user_id=30fecfd55909439d921b0ed8c91d87fd, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.272029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.289942 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1351/2705] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:53 2022] PUT /identity/v3/projects/c9d1fcd9365847dbbcdc352fa543ae45/users/30fecfd55909439d921b0ed8c91d87fd/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:53.294879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.305869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd624-60ff-4e98-917d-604d7b59b6db admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.365350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52f60d-db61-4364-a8c4-6f643b470b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.366015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f60d-db61-4364-a8c4-6f643b470b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.366295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f60d-db61-4364-a8c4-6f643b470b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.366934 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f60d-db61-4364-a8c4-6f643b470b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.367777 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52f60d-db61-4364-a8c4-6f643b470b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.369432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52f60d-db61-4364-a8c4-6f643b470b66 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.379237 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1355/2706] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:53.383504 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.393879 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2870-1cff-43df-ba5c-98d5b54bd86e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.399050 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.399938 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.400208 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.400514 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] PATH_INFO: `/v3/projects/c9d1fcd9365847dbbcdc352fa543ae45/users/30fecfd55909439d921b0ed8c91d87fd/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.402740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d1fcd9365847dbbcdc352fa543ae45, user_id=30fecfd55909439d921b0ed8c91d87fd, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.405469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.416197 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1352/2707] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:53 2022] PUT /identity/v3/projects/c9d1fcd9365847dbbcdc352fa543ae45/users/30fecfd55909439d921b0ed8c91d87fd/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:53.426154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855ac1-e657-402d-b5c9-a7c98624dbdf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.426439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855ac1-e657-402d-b5c9-a7c98624dbdf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.426713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855ac1-e657-402d-b5c9-a7c98624dbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.453206 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-57855ac1-e657-402d-b5c9-a7c98624dbdf None None] MFA Rules not processed for user `30fecfd55909439d921b0ed8c91d87fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:53.454416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-57855ac1-e657-402d-b5c9-a7c98624dbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:53.531162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1356/2708] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:53.542791 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.544885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:53.589139 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:53.605769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2c8b-db09-40db-bf98-272e87624900 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.609779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.610410 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.610691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.610961 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.620530 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.621983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.631783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1353/2709] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:53.724921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855ac1-e657-402d-b5c9-a7c98624dbdf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:53.734767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855ac1-e657-402d-b5c9-a7c98624dbdf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:53.738547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3c339-1430-4133-ab3a-907f7ed4ee0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:53.739169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3c339-1430-4133-ab3a-907f7ed4ee0c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:53.739451 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3c339-1430-4133-ab3a-907f7ed4ee0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:53.739724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3c339-1430-4133-ab3a-907f7ed4ee0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:53.797776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3c339-1430-4133-ab3a-907f7ed4ee0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:53.799212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3c339-1430-4133-ab3a-907f7ed4ee0c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:53.808380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1357/2710] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:56.710743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:56.773756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944233-629e-46d2-9c71-acc4e1142162 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:56.778862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:56.779718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:56.779998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:56.780269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] PATH_INFO: `/v3/users/e261ca7037154660a119cff3374f7a0d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:56.781513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e261ca7037154660a119cff3374f7a0d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:56.783449 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:56.836173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e261ca7037154660a119cff3374f7a0d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:56.836834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e261ca7037154660a119cff3374f7a0d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:56.837415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e261ca7037154660a119cff3374f7a0d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:56.845956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e261ca7037154660a119cff3374f7a0d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:56.858204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e261ca7037154660a119cff3374f7a0d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:56.871609 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1354/2711] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:42:56 2022] DELETE /identity/v3/users/e261ca7037154660a119cff3374f7a0d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:56.876182 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:56.876738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:56.876738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:56.882846 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:56.896318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:56.897552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:56.958646 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1358/2712] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:56.968562 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:56.970125 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:57.029624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9561a-77c1-4c5f-8775-9761d1d57fd2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:57.035216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:57.036304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:57.036965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:57.037405 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:57.053587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:57.055446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:57.065508 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1355/2713] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:57.354796 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:57.356407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:57.369030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421d8f0-cbef-438f-8525-b75985a5cc9e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:57.374652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:57.375547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:57.375819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:57.376081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] PATH_INFO: `/v3/projects/919bcf4b0dd54d93917aca8e2e964962` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:57.377352 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919bcf4b0dd54d93917aca8e2e964962)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:57.379292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:57.428251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919bcf4b0dd54d93917aca8e2e964962', 'request_id': 'req-40740987-f368-4b6e-961b-275f714e7f18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.433755 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919bcf4b0dd54d93917aca8e2e964962', 'request_id': 'req-40740987-f368-4b6e-961b-275f714e7f18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.439818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919bcf4b0dd54d93917aca8e2e964962', 'request_id': 'req-40740987-f368-4b6e-961b-275f714e7f18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.452992 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] The token cache is being invalidate because project 919bcf4b0dd54d93917aca8e2e964962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:57.453272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.453869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.455652 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1359/2714] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:57 2022] DELETE /identity/v3/projects/919bcf4b0dd54d93917aca8e2e964962 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:57.459459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:57.464315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:57.471173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc188a97-9824-44d6-9972-8c95194d34f2 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:57.531864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:57.532773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:57.533051 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:57.533324 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] PATH_INFO: `/v3/users/30fecfd55909439d921b0ed8c91d87fd` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:57.534528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fecfd55909439d921b0ed8c91d87fd)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:57.536441 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:57.585173 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fecfd55909439d921b0ed8c91d87fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.585881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fecfd55909439d921b0ed8c91d87fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.586521 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fecfd55909439d921b0ed8c91d87fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.596964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fecfd55909439d921b0ed8c91d87fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.610454 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e8c9b237-acbe-431e-afbb-44acd2248396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fecfd55909439d921b0ed8c91d87fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:57.623406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1356/2715] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:42:57 2022] DELETE /identity/v3/users/30fecfd55909439d921b0ed8c91d87fd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:57.907733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:57.909415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:57.923897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40740987-f368-4b6e-961b-275f714e7f18 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:57.984222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:57.985068 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:57.985345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:57.985611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] PATH_INFO: `/v3/projects/c9d1fcd9365847dbbcdc352fa543ae45` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:57.986937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d1fcd9365847dbbcdc352fa543ae45)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:57.988947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.023030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:58.039983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d1fcd9365847dbbcdc352fa543ae45', 'request_id': 'req-d4cc10c6-f005-4e78-8176-95dd54125cb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:58.045555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d1fcd9365847dbbcdc352fa543ae45', 'request_id': 'req-d4cc10c6-f005-4e78-8176-95dd54125cb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:58.051905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d1fcd9365847dbbcdc352fa543ae45', 'request_id': 'req-d4cc10c6-f005-4e78-8176-95dd54125cb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:58.065853 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] The token cache is being invalidate because project c9d1fcd9365847dbbcdc352fa543ae45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:58.066141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:58.066897 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d4cc10c6-f005-4e78-8176-95dd54125cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:58.068587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1360/2716] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:57 2022] DELETE /identity/v3/projects/c9d1fcd9365847dbbcdc352fa543ae45 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:58.073684 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3afea-bd57-4c6b-a1c9-4bae48c37526 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.074179 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3afea-bd57-4c6b-a1c9-4bae48c37526 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.074390 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3afea-bd57-4c6b-a1c9-4bae48c37526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.093119 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-71d3afea-bd57-4c6b-a1c9-4bae48c37526 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:58.094330 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-71d3afea-bd57-4c6b-a1c9-4bae48c37526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:58.156987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1357/2717] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:58.165086 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afdf8c-82e3-4ba7-b049-3e05f389e96e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.165373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afdf8c-82e3-4ba7-b049-3e05f389e96e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.165640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afdf8c-82e3-4ba7-b049-3e05f389e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.183858 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c6afdf8c-82e3-4ba7-b049-3e05f389e96e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:58.185122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c6afdf8c-82e3-4ba7-b049-3e05f389e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:58.193203 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1361/2718] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:58.197566 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3afea-bd57-4c6b-a1c9-4bae48c37526 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.207790 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3afea-bd57-4c6b-a1c9-4bae48c37526 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.212936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.213577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.213854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.214099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.214816 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:42:58.215118 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.216747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.228773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1358/2719] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:42:58.233160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afdf8c-82e3-4ba7-b049-3e05f389e96e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.243052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afdf8c-82e3-4ba7-b049-3e05f389e96e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.248546 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.249378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.249687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.249951 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.250644 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.252590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.280520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1362/2720] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:58 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:58.284670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.294858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891b28-15e3-41bc-9b56-74026f515ecc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.299855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:58.356096 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.356799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.357082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.357358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.358037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.359961 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.387338 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1359/2721] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:42:58 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:58.391548 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.402315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557e521-5603-4a5e-a245-8d6bb23722a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.407936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.408594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.409019 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.409285 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.410017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.411633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.422454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1363/2722] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:58.426579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.437058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a9703-7123-4e4f-aa5a-2d53385ca8d5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.442270 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01f461-c661-4f77-927a-9bb4884fd6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.442922 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01f461-c661-4f77-927a-9bb4884fd6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.443206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01f461-c661-4f77-927a-9bb4884fd6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.443477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01f461-c661-4f77-927a-9bb4884fd6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.444209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01f461-c661-4f77-927a-9bb4884fd6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.446049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01f461-c661-4f77-927a-9bb4884fd6d0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.456528 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1360/2723] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:58.461016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.471052 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92f7ef-de4a-4bd7-891c-e51e3568c22f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.475914 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.476906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.477189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.477461 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] PATH_INFO: `/v3/projects/fb8f917ff7384423a85611a912237320/users/04897e93c837420f8ba834f3df2f485b/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.493876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8f917ff7384423a85611a912237320, user_id=04897e93c837420f8ba834f3df2f485b, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.496552 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.515275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1364/2724] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:58 2022] PUT /identity/v3/projects/fb8f917ff7384423a85611a912237320/users/04897e93c837420f8ba834f3df2f485b/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:58.528152 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a863-11e4-44eb-b01c-aebf4b5eb88b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.528462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a863-11e4-44eb-b01c-aebf4b5eb88b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.528764 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a863-11e4-44eb-b01c-aebf4b5eb88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.555705 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8d64a863-11e4-44eb-b01c-aebf4b5eb88b None None] MFA Rules not processed for user `04897e93c837420f8ba834f3df2f485b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:58.556955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8d64a863-11e4-44eb-b01c-aebf4b5eb88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:58.624007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1361/2725] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:58.628731 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.701684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff78b4-654d-49d3-8b16-4d6fb74cced2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.709380 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.710332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.710624 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.710953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.711634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.713565 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.740912 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1365/2726] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:58 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:58.745710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a863-11e4-44eb-b01c-aebf4b5eb88b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.757690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a863-11e4-44eb-b01c-aebf4b5eb88b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.816513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.817223 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.817494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.817760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.818506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.820447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.845871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1362/2727] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:42:58 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:58.847040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.857574 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88d090-a6f8-448e-ac89-9a90e10692d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.862412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.863070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.863348 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.863619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.864389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.866039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.877012 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1366/2728] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:58.881191 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.892020 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd691e-1b7c-4331-a543-4ea39355dd5e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.898063 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:58.898974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:58.899249 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:58.899515 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] PATH_INFO: `/v3/projects/8a5193c48a9142ac91204330d91068fd/users/91c9d4432b2541819d543d022edfadea/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:58.901952 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:58.919650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5193c48a9142ac91204330d91068fd, user_id=91c9d4432b2541819d543d022edfadea, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:58.922347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:58.937038 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1363/2729] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:58 2022] PUT /identity/v3/projects/8a5193c48a9142ac91204330d91068fd/users/91c9d4432b2541819d543d022edfadea/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:42:58.941129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:58.952204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9f1e-7410-48b9-8180-ee586aa57107 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:58.977033 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:59.012901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9807fa2-7b5a-4e88-87dc-019f2ce7b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:59.013479 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807fa2-7b5a-4e88-87dc-019f2ce7b316 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.013765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807fa2-7b5a-4e88-87dc-019f2ce7b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.014025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807fa2-7b5a-4e88-87dc-019f2ce7b316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.014732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9807fa2-7b5a-4e88-87dc-019f2ce7b316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:59.016613 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9807fa2-7b5a-4e88-87dc-019f2ce7b316 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:59.026337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1367/2730] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:42:59.030558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:59.049088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adfc2a-ae1b-427d-af6a-ef7c2205d483 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:59.053935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:59.056750 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.057030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.057299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] PATH_INFO: `/v3/projects/8a5193c48a9142ac91204330d91068fd/users/91c9d4432b2541819d543d022edfadea/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.059406 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5193c48a9142ac91204330d91068fd, user_id=91c9d4432b2541819d543d022edfadea, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:59.062043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:59.076128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1364/2731] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:42:59 2022] PUT /identity/v3/projects/8a5193c48a9142ac91204330d91068fd/users/91c9d4432b2541819d543d022edfadea/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:42:59.087127 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25a01-2c96-4315-a037-8c86d4f54e60 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.087441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25a01-2c96-4315-a037-8c86d4f54e60 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.087819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25a01-2c96-4315-a037-8c86d4f54e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.120570 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-00f25a01-2c96-4315-a037-8c86d4f54e60 None None] MFA Rules not processed for user `91c9d4432b2541819d543d022edfadea`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:42:59.121824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-00f25a01-2c96-4315-a037-8c86d4f54e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:59.195130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1368/2732] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:42:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:42:59.207527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:59.209388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:42:59.271424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475ce3-3f6a-4f2d-ac7b-f215d5f458b0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:59.276029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:59.276672 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.276967 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.277239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.286635 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:59.288056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:59.297575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1365/2733] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:42:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:42:59.638500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25a01-2c96-4315-a037-8c86d4f54e60 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:59.648025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25a01-2c96-4315-a037-8c86d4f54e60 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:59.653288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c9d4432b2541819d543d022edfadea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5193c48a9142ac91204330d91068fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:59.654002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.654331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.654603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.655326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:42:59.655636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:59.657297 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:59.669223 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1369/2734] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:42:59.673509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:59.682773 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef2b2-96f9-47f6-8a4e-423f12e41cdf service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:59.688265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c9d4432b2541819d543d022edfadea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5193c48a9142ac91204330d91068fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:59.689031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.689317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.689582 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.690289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:59.692186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:59.722034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1366/2735] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:42:59 2022] POST /identity/v3/projects => generated 354 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:42:59.726169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:59.736343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfcee4-de44-4c28-983c-e0ccdc932613 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:59.793824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c9d4432b2541819d543d022edfadea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5193c48a9142ac91204330d91068fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:59.794486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.794772 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.795049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.795776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:42:59.796082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:59.797765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:59.810298 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1370/2736] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:42:59.847196 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:42:59.859240 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79d69-67aa-452e-8cb5-dc2d9782ad32 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:42:59.864876 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c9d4432b2541819d543d022edfadea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5193c48a9142ac91204330d91068fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:42:59.865712 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:42:59.865998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:42:59.866292 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] PATH_INFO: `/v3/projects/13309928d48d4d3f8532d37ab358bfe6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:42:59.867878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13309928d48d4d3f8532d37ab358bfe6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:42:59.869825 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:42:59.924788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13309928d48d4d3f8532d37ab358bfe6', 'request_id': 'req-274e6955-3023-4cb6-a44f-67643933576a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:59.930933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13309928d48d4d3f8532d37ab358bfe6', 'request_id': 'req-274e6955-3023-4cb6-a44f-67643933576a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:59.937139 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13309928d48d4d3f8532d37ab358bfe6', 'request_id': 'req-274e6955-3023-4cb6-a44f-67643933576a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:59.951469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] The token cache is being invalidate because project 13309928d48d4d3f8532d37ab358bfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:42:59.951738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:59.952398 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-274e6955-3023-4cb6-a44f-67643933576a tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:42:59.954111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1367/2737] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:42:59 2022] DELETE /identity/v3/projects/13309928d48d4d3f8532d37ab358bfe6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:00.158966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:00.160733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:00.196462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:00.235963 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19df588-d05f-4d45-952c-fcfe80c48163 tempest-VolumeQuotaClassesTest-1212306586 tempest-VolumeQuotaClassesTest-1212306586-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:00.301211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:00.302517 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:00.302877 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:00.303225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] PATH_INFO: `/v3/users/04897e93c837420f8ba834f3df2f485b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:00.305053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=04897e93c837420f8ba834f3df2f485b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:00.307027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:00.361027 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04897e93c837420f8ba834f3df2f485b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.361686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04897e93c837420f8ba834f3df2f485b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.370266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04897e93c837420f8ba834f3df2f485b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.382326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04897e93c837420f8ba834f3df2f485b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.389342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04897e93c837420f8ba834f3df2f485b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.395593 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1371/2738] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:00 2022] DELETE /identity/v3/users/04897e93c837420f8ba834f3df2f485b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:00.400377 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:00.400910 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:00.401035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:00.420478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:00.421704 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:00.460229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:00.497908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1368/2739] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:00.508208 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:00.509750 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:00.570207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5fb7-38bb-4550-98ff-e1b5a33bf23b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:00.574372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:00.575020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:00.575295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:00.575564 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:00.584871 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:00.586470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:00.590529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:00.597690 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1372/2740] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:00.890446 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:00.891946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:00.905074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe7d1a-d988-4b49-a768-76ba2e023a08 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:00.909845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:00.910686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:00.910987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:00.911288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] PATH_INFO: `/v3/projects/fb8f917ff7384423a85611a912237320` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:00.912613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8f917ff7384423a85611a912237320)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:00.914460 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:00.962584 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8f917ff7384423a85611a912237320', 'request_id': 'req-1aeb9428-235a-4358-93cb-fc91649a7aed'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.968009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8f917ff7384423a85611a912237320', 'request_id': 'req-1aeb9428-235a-4358-93cb-fc91649a7aed'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.974235 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8f917ff7384423a85611a912237320', 'request_id': 'req-1aeb9428-235a-4358-93cb-fc91649a7aed'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.988423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] The token cache is being invalidate because project fb8f917ff7384423a85611a912237320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:00.988735 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.989345 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:00.990866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1369/2741] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:00 2022] DELETE /identity/v3/projects/fb8f917ff7384423a85611a912237320 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:00.995344 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:01.005018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354da9-ffa0-47f1-aafe-1800ee015599 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:01.064483 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:01.065414 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.065675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.067410 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] PATH_INFO: `/v3/users/91c9d4432b2541819d543d022edfadea` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.068741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c9d4432b2541819d543d022edfadea)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:01.070842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:01.125586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c9d4432b2541819d543d022edfadea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.126214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c9d4432b2541819d543d022edfadea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.135400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c9d4432b2541819d543d022edfadea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.147149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c9d4432b2541819d543d022edfadea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.153891 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9f34d74-80ff-4f85-b104-fb77b0e9c38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c9d4432b2541819d543d022edfadea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.159654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1373/2742] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:00 2022] DELETE /identity/v3/users/91c9d4432b2541819d543d022edfadea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:01.448703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:01.450465 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:01.467318 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb9428-235a-4358-93cb-fc91649a7aed admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:01.528054 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:01.528948 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.529222 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.529490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] PATH_INFO: `/v3/projects/8a5193c48a9142ac91204330d91068fd` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.530690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5193c48a9142ac91204330d91068fd)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:01.532579 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:01.583031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5193c48a9142ac91204330d91068fd', 'request_id': 'req-4a4b9339-0c4e-407b-bbe6-282219e20f32'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.589024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5193c48a9142ac91204330d91068fd', 'request_id': 'req-4a4b9339-0c4e-407b-bbe6-282219e20f32'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.590088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:01.596805 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5193c48a9142ac91204330d91068fd', 'request_id': 'req-4a4b9339-0c4e-407b-bbe6-282219e20f32'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.610907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] The token cache is being invalidate because project 8a5193c48a9142ac91204330d91068fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:01.611186 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.611778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4a4b9339-0c4e-407b-bbe6-282219e20f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:01.613349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1370/2743] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:01 2022] DELETE /identity/v3/projects/8a5193c48a9142ac91204330d91068fd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:01.618621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824558b-1412-4241-be29-c161e09e00de None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.618905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824558b-1412-4241-be29-c161e09e00de None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.619172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824558b-1412-4241-be29-c161e09e00de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.637491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7824558b-1412-4241-be29-c161e09e00de None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:01.638685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7824558b-1412-4241-be29-c161e09e00de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:01.695820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1374/2744] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:01.704743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d117b-585d-4d94-b6d6-4fc31fb9ee98 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.705024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d117b-585d-4d94-b6d6-4fc31fb9ee98 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.705297 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d117b-585d-4d94-b6d6-4fc31fb9ee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.724150 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-db4d117b-585d-4d94-b6d6-4fc31fb9ee98 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:01.725383 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db4d117b-585d-4d94-b6d6-4fc31fb9ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:01.733855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1371/2745] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:01.738252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824558b-1412-4241-be29-c161e09e00de None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:01.749017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824558b-1412-4241-be29-c161e09e00de None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:01.754543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:01.755197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.755475 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.755801 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.756594 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:43:01.756865 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:01.758562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:01.771128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1375/2746] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:43:01.775646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d117b-585d-4d94-b6d6-4fc31fb9ee98 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:01.785335 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d117b-585d-4d94-b6d6-4fc31fb9ee98 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:01.790931 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:01.791575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.791860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.792130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.792836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:01.794710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:01.826037 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1372/2747] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:43:01 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:01.827170 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:01.833597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:01.837575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb392e-1090-4129-b8a1-53649005343c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:01.897485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:01.898155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.898432 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.898701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.899373 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:01.901363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:01.922491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1376/2748] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:43:01 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:01.926778 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:01.937275 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2780f9-e5a5-4829-aeb0-e669e10bf9fe admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:01.941787 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:01.942459 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.942739 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.943009 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.943734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:01.945433 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:01.955742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1373/2749] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:01.959704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:01.970338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8220c0b-68ce-4316-bc1f-664f21106c67 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:01.975744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738627da-7001-433b-969b-aac078baf5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:01.976439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738627da-7001-433b-969b-aac078baf5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:01.976775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738627da-7001-433b-969b-aac078baf5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:01.977049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738627da-7001-433b-969b-aac078baf5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:01.977776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738627da-7001-433b-969b-aac078baf5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:01.979378 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738627da-7001-433b-969b-aac078baf5d8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:01.989374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1377/2750] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:01.993697 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.003604 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacc92a-2ee6-4d8d-8ebf-7a7551311090 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.008677 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.009512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.009786 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.010056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] PATH_INFO: `/v3/projects/42ba876ab6524b5bbc2c5bee604f2692/users/79ee034e690740d69449aa8b85807439/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.026417 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ba876ab6524b5bbc2c5bee604f2692, user_id=79ee034e690740d69449aa8b85807439, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.029102 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.045795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1374/2751] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:43:01 2022] PUT /identity/v3/projects/42ba876ab6524b5bbc2c5bee604f2692/users/79ee034e690740d69449aa8b85807439/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:02.056697 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36564-b0d9-484c-99b0-407a2b90a9a6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.057058 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36564-b0d9-484c-99b0-407a2b90a9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.057423 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f36564-b0d9-484c-99b0-407a2b90a9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.088260 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-20f36564-b0d9-484c-99b0-407a2b90a9a6 None None] MFA Rules not processed for user `79ee034e690740d69449aa8b85807439`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:02.089499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-20f36564-b0d9-484c-99b0-407a2b90a9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:02.159111 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1378/2752] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:02.164001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.229485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d212-1460-4fb9-b43f-cf3a9ca2de47 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.234871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.235552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.235833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.236103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.236814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.238699 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.266276 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1375/2753] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:43:02 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:02.270449 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f36564-b0d9-484c-99b0-407a2b90a9a6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.281508 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f36564-b0d9-484c-99b0-407a2b90a9a6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.342163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.342830 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.343108 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.343377 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.344073 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.346106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.367803 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1379/2754] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:43:02 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:02.371933 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.382613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4c18-c65c-41e7-80d3-c39ce199465f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.388030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.388743 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.389021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.389285 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.390036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.391616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.402517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1376/2755] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:02.406629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.412030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:02.418471 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1696b8-7a10-4446-bc6a-08aeed5cc259 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.423605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.424485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.424824 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.425141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] PATH_INFO: `/v3/projects/1aa837f036ba4d308e4f41ae0079e777/users/341a56321ea24ebd8de9c9e85ee877fe/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.439809 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa837f036ba4d308e4f41ae0079e777, user_id=341a56321ea24ebd8de9c9e85ee877fe, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.442514 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.456790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1380/2756] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:43:02 2022] PUT /identity/v3/projects/1aa837f036ba4d308e4f41ae0079e777/users/341a56321ea24ebd8de9c9e85ee877fe/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:02.460832 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.470886 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b478fc-d62c-489c-8d3c-954077060220 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.529471 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:02.536302 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b50d3c-3dca-42b7-8d09-8a75518c406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.537134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50d3c-3dca-42b7-8d09-8a75518c406c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.537571 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50d3c-3dca-42b7-8d09-8a75518c406c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.537904 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50d3c-3dca-42b7-8d09-8a75518c406c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.538799 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b50d3c-3dca-42b7-8d09-8a75518c406c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.541188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b50d3c-3dca-42b7-8d09-8a75518c406c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.551301 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1377/2757] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:02.555619 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.566859 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5f84-78c4-4270-986f-c5d1b17a8fc4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.572279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.573248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.573523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.573794 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] PATH_INFO: `/v3/projects/1aa837f036ba4d308e4f41ae0079e777/users/341a56321ea24ebd8de9c9e85ee877fe/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.575885 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa837f036ba4d308e4f41ae0079e777, user_id=341a56321ea24ebd8de9c9e85ee877fe, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.578567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.590981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1381/2758] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:43:02 2022] PUT /identity/v3/projects/1aa837f036ba4d308e4f41ae0079e777/users/341a56321ea24ebd8de9c9e85ee877fe/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:02.602131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e365-60e5-4318-85e4-bc0cc2887807 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.602428 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e365-60e5-4318-85e4-bc0cc2887807 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.602703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e365-60e5-4318-85e4-bc0cc2887807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.631621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-22f8e365-60e5-4318-85e4-bc0cc2887807 None None] MFA Rules not processed for user `341a56321ea24ebd8de9c9e85ee877fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:02.633024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-22f8e365-60e5-4318-85e4-bc0cc2887807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:02.706218 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1378/2759] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:02.719591 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.722946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:02.787470 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc350a37-844a-4e24-9f20-e41194c87482 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.792066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.792742 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.793021 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.793291 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.803367 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.804936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:02.814547 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1382/2760] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:02.913875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8e365-60e5-4318-85e4-bc0cc2887807 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:02.924760 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8e365-60e5-4318-85e4-bc0cc2887807 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:02.929207 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa5144-1449-433d-b14c-e712cac1bc56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:02.929899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa5144-1449-433d-b14c-e712cac1bc56 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:02.930172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa5144-1449-433d-b14c-e712cac1bc56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:02.930438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa5144-1449-433d-b14c-e712cac1bc56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:02.992411 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa5144-1449-433d-b14c-e712cac1bc56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:02.993883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa5144-1449-433d-b14c-e712cac1bc56 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:03.002988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1379/2761] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:05.600829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:05.678096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecf0c-94d7-44df-b620-fc175fd9e79c service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:05.684904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:05.685960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:05.686335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:05.686723 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] PATH_INFO: `/v3/users/79ee034e690740d69449aa8b85807439` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:05.688207 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ee034e690740d69449aa8b85807439)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:05.690355 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:05.740957 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ee034e690740d69449aa8b85807439'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:05.741945 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ee034e690740d69449aa8b85807439'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:05.751097 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ee034e690740d69449aa8b85807439'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:05.763899 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:05.765129 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ee034e690740d69449aa8b85807439'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:05.773004 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ee034e690740d69449aa8b85807439'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:05.779279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1383/2762] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:05 2022] DELETE /identity/v3/users/79ee034e690740d69449aa8b85807439 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:05.783846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:05.784342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:05.784447 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:05.801759 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:05.802946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:05.875269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1380/2763] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:05.885299 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:05.886932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:05.947162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433527-48cf-4057-a1f8-edd368897857 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:05.951117 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:05.951757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:05.952036 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:05.952306 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:05.961604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:05.963039 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:05.972605 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1384/2764] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:06.257253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:06.259067 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:06.272369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333f677-7060-4332-9e19-c2fa77d47fa8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:06.277755 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:06.278637 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:06.278905 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:06.279210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] PATH_INFO: `/v3/projects/42ba876ab6524b5bbc2c5bee604f2692` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:06.280512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ba876ab6524b5bbc2c5bee604f2692)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:06.282485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:06.295478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:06.336300 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ba876ab6524b5bbc2c5bee604f2692', 'request_id': 'req-13e29bbf-6221-4cc1-ae97-5419b972857d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.342216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ba876ab6524b5bbc2c5bee604f2692', 'request_id': 'req-13e29bbf-6221-4cc1-ae97-5419b972857d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.349801 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ba876ab6524b5bbc2c5bee604f2692', 'request_id': 'req-13e29bbf-6221-4cc1-ae97-5419b972857d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.363956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] The token cache is being invalidate because project 42ba876ab6524b5bbc2c5bee604f2692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:06.364243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.364901 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.366800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1381/2765] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:06 2022] DELETE /identity/v3/projects/42ba876ab6524b5bbc2c5bee604f2692 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:06.372311 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:06.382422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9ff40-7b61-4e8f-b7b7-4660e9bae656 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:06.442937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:06.443810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:06.444091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:06.444343 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] PATH_INFO: `/v3/users/341a56321ea24ebd8de9c9e85ee877fe` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:06.445582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=341a56321ea24ebd8de9c9e85ee877fe)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:06.447510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:06.497338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341a56321ea24ebd8de9c9e85ee877fe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.498049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341a56321ea24ebd8de9c9e85ee877fe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.507326 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341a56321ea24ebd8de9c9e85ee877fe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.520387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341a56321ea24ebd8de9c9e85ee877fe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.527132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dcf7c0c2-0ba6-48e3-987c-b8c23a696d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341a56321ea24ebd8de9c9e85ee877fe'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.533205 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1385/2766] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:06 2022] DELETE /identity/v3/users/341a56321ea24ebd8de9c9e85ee877fe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:06.811527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:06.813101 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:06.826269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29bbf-6221-4cc1-ae97-5419b972857d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:06.883155 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:06.884019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:06.884295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:06.884567 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] PATH_INFO: `/v3/projects/1aa837f036ba4d308e4f41ae0079e777` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:06.885777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa837f036ba4d308e4f41ae0079e777)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:06.887710 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:06.937858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa837f036ba4d308e4f41ae0079e777', 'request_id': 'req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.943374 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa837f036ba4d308e4f41ae0079e777', 'request_id': 'req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.949389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa837f036ba4d308e4f41ae0079e777', 'request_id': 'req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.964826 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] The token cache is being invalidate because project 1aa837f036ba4d308e4f41ae0079e777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:06.965135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.965756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-70817ff4-55ac-4bfe-83f7-c37f9fd84b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:06.967295 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1382/2767] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:06 2022] DELETE /identity/v3/projects/1aa837f036ba4d308e4f41ae0079e777 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:06.972312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42d5b-cd5c-4770-8134-fd51dfd1eae5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:06.972832 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42d5b-cd5c-4770-8134-fd51dfd1eae5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:06.972954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42d5b-cd5c-4770-8134-fd51dfd1eae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:06.992054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5dc42d5b-cd5c-4770-8134-fd51dfd1eae5 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:06.993289 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5dc42d5b-cd5c-4770-8134-fd51dfd1eae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:06.997771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:07.057725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1386/2768] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:07.126674 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715b16-6efe-4c6b-a796-245cc037808c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.127036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715b16-6efe-4c6b-a796-245cc037808c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.127349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715b16-6efe-4c6b-a796-245cc037808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.149089 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bf715b16-6efe-4c6b-a796-245cc037808c None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:07.150299 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bf715b16-6efe-4c6b-a796-245cc037808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:07.160087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1383/2769] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:43:07.165066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc42d5b-cd5c-4770-8134-fd51dfd1eae5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.180001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc42d5b-cd5c-4770-8134-fd51dfd1eae5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.188869 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.189793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.190155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.190503 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.191633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:43:07.192031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.194610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.210581 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1387/2770] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:43:07.212358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf715b16-6efe-4c6b-a796-245cc037808c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.223421 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf715b16-6efe-4c6b-a796-245cc037808c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.229340 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.229992 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.230269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.230537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.231221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.233164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.261003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1384/2771] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:43:07 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:07.265318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.276030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d240-3c67-4fd6-85ae-009fa35c8332 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.334334 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.334955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.335225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.335512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.336212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.338272 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.361397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1388/2772] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:43:07 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:07.365751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.371620 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:07.378559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80740-43bf-4a71-859e-c69bb57d75c8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.384510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.385214 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.385496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.385769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.386511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.388135 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.400873 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1385/2773] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:07.405716 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.416964 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc293f5-0834-4bc6-922b-d45de48d8666 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.423160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9e66d-817b-4c53-a3c6-de57649c83fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.423820 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9e66d-817b-4c53-a3c6-de57649c83fe admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.424100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9e66d-817b-4c53-a3c6-de57649c83fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.424365 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9e66d-817b-4c53-a3c6-de57649c83fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.425118 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9e66d-817b-4c53-a3c6-de57649c83fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.426741 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9e66d-817b-4c53-a3c6-de57649c83fe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.437381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1389/2774] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:07.441737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.452284 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ed58-87c9-4f98-b18f-fc8331ad23a6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.457698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.458577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.458855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.459128 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] PATH_INFO: `/v3/projects/bfa2a91376cf46c3adf7c193c8f2018b/users/f99b21258c2b4b39a317b0046e22620a/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.479653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa2a91376cf46c3adf7c193c8f2018b, user_id=f99b21258c2b4b39a317b0046e22620a, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.483388 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.499613 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1386/2775] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:43:07 2022] PUT /identity/v3/projects/bfa2a91376cf46c3adf7c193c8f2018b/users/f99b21258c2b4b39a317b0046e22620a/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:07.509937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6568a-2621-4315-8c04-3001573a680d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.510321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6568a-2621-4315-8c04-3001573a680d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.510595 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6568a-2621-4315-8c04-3001573a680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.539013 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-72a6568a-2621-4315-8c04-3001573a680d None None] MFA Rules not processed for user `f99b21258c2b4b39a317b0046e22620a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:07.540258 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-72a6568a-2621-4315-8c04-3001573a680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:07.607775 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1390/2776] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:07.612834 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.680666 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bf9d4-65a5-47da-a8ea-eaac46d42fc3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.686821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.687643 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.687918 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.688178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.688891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.690924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.721426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1387/2777] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:43:07 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:07.726156 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6568a-2621-4315-8c04-3001573a680d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.735781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:07.741611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6568a-2621-4315-8c04-3001573a680d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.798901 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.799558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.799836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.800105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.800828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.802739 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.826928 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1391/2778] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:43:07 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:07.831341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.842237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2626015-ad3e-405a-9493-bdef12dbc89e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.847444 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.848099 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.848380 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.848675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.849399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.850989 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.862076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1388/2779] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:07.867045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.877321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e0a0-710c-44ff-9688-f49756f910c5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.882622 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.883502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.883780 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.884045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] PATH_INFO: `/v3/projects/936bb437526a4fdbbcf18dbb29342dc0/users/c1cea28e22c54d398a21587c2442132d/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:07.898634 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936bb437526a4fdbbcf18dbb29342dc0, user_id=c1cea28e22c54d398a21587c2442132d, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:07.901331 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:07.916981 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1392/2780] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:43:07 2022] PUT /identity/v3/projects/936bb437526a4fdbbcf18dbb29342dc0/users/c1cea28e22c54d398a21587c2442132d/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:07.920985 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:07.936073 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98788c60-d8c4-4df1-8cc7-1b27ef236c73 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:07.998230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3f9c-752d-4bd0-b93b-e08d3335d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:07.998883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3f9c-752d-4bd0-b93b-e08d3335d559 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:07.999161 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3f9c-752d-4bd0-b93b-e08d3335d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:07.999436 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3f9c-752d-4bd0-b93b-e08d3335d559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:08.000162 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3f9c-752d-4bd0-b93b-e08d3335d559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:08.001796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3f9c-752d-4bd0-b93b-e08d3335d559 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:08.013839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1389/2781] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:08.019926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:08.036091 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7839b-5849-42dd-93f3-3c6f18532922 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:08.043109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:08.044001 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:08.044281 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:08.044558 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] PATH_INFO: `/v3/projects/936bb437526a4fdbbcf18dbb29342dc0/users/c1cea28e22c54d398a21587c2442132d/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:08.046917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936bb437526a4fdbbcf18dbb29342dc0, user_id=c1cea28e22c54d398a21587c2442132d, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:08.049633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:08.063429 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1393/2782] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:43:08 2022] PUT /identity/v3/projects/936bb437526a4fdbbcf18dbb29342dc0/users/c1cea28e22c54d398a21587c2442132d/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:08.077744 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82c06-bb03-4c21-bb6a-a4fff2c4766e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:08.078031 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82c06-bb03-4c21-bb6a-a4fff2c4766e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:08.078305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a82c06-bb03-4c21-bb6a-a4fff2c4766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:08.104898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b1a82c06-bb03-4c21-bb6a-a4fff2c4766e None None] MFA Rules not processed for user `c1cea28e22c54d398a21587c2442132d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:08.106103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b1a82c06-bb03-4c21-bb6a-a4fff2c4766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:08.133492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:08.182919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1390/2783] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:08.193691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:08.195760 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:08.272845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c107-efc9-405d-959c-dedf25920233 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:08.279492 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa291adf-98d6-4b20-a839-506eefcf8570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:08.280389 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291adf-98d6-4b20-a839-506eefcf8570 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:08.280749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291adf-98d6-4b20-a839-506eefcf8570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:08.281040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291adf-98d6-4b20-a839-506eefcf8570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:08.349582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa291adf-98d6-4b20-a839-506eefcf8570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:08.351077 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa291adf-98d6-4b20-a839-506eefcf8570 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:08.361169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1394/2784] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:10.928846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82c06-bb03-4c21-bb6a-a4fff2c4766e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:10.992074 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a82c06-bb03-4c21-bb6a-a4fff2c4766e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:10.996902 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:10.997769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:10.998046 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:10.998309 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] PATH_INFO: `/v3/users/f99b21258c2b4b39a317b0046e22620a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:10.999520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99b21258c2b4b39a317b0046e22620a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:11.001476 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:11.053955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99b21258c2b4b39a317b0046e22620a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.054599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99b21258c2b4b39a317b0046e22620a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.055201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99b21258c2b4b39a317b0046e22620a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.063756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99b21258c2b4b39a317b0046e22620a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.075621 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99b21258c2b4b39a317b0046e22620a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.087855 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1391/2785] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:10 2022] DELETE /identity/v3/users/f99b21258c2b4b39a317b0046e22620a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:11.092531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:11.093061 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:11.093177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:11.110907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:11.112088 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:11.117604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:11.174430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1395/2786] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:11.184317 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:11.185930 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:11.233429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:11.247616 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c16c-e167-417f-84fd-d05cfc4de441 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:11.251420 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:11.252094 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:11.252370 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:11.252656 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:11.262070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:11.263478 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:11.273271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1392/2787] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:11.560034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:11.561551 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:11.574165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1f7e6-6dcc-4c24-bf71-e7ffb763fc06 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:11.579263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:11.580172 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:11.580603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:11.580904 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] PATH_INFO: `/v3/projects/bfa2a91376cf46c3adf7c193c8f2018b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:11.582160 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa2a91376cf46c3adf7c193c8f2018b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:11.584125 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:11.632335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa2a91376cf46c3adf7c193c8f2018b', 'request_id': 'req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.637719 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa2a91376cf46c3adf7c193c8f2018b', 'request_id': 'req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.644014 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa2a91376cf46c3adf7c193c8f2018b', 'request_id': 'req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.657486 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] The token cache is being invalidate because project bfa2a91376cf46c3adf7c193c8f2018b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:11.657793 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.658482 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.660081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1396/2788] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:11 2022] DELETE /identity/v3/projects/bfa2a91376cf46c3adf7c193c8f2018b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:11.664238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:11.674011 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267eabf-78be-48aa-98c1-00a9ed4c7538 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:11.736477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:11.737290 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:11.737580 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:11.737814 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] PATH_INFO: `/v3/users/c1cea28e22c54d398a21587c2442132d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:11.739121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cea28e22c54d398a21587c2442132d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:11.741426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:11.794550 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cea28e22c54d398a21587c2442132d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.795228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cea28e22c54d398a21587c2442132d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.796001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cea28e22c54d398a21587c2442132d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.805936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cea28e22c54d398a21587c2442132d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.820244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7726d306-eecb-487e-9b8d-32ffc924a8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cea28e22c54d398a21587c2442132d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:11.834087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1393/2789] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:11 2022] DELETE /identity/v3/users/c1cea28e22c54d398a21587c2442132d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:12.114441 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.116340 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:12.130842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd2b63-6dcf-47d9-89fc-a8e76ac22f23 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.189943 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.190829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.191099 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.191366 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] PATH_INFO: `/v3/projects/936bb437526a4fdbbcf18dbb29342dc0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.192597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=936bb437526a4fdbbcf18dbb29342dc0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.194611 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.234618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:12.257500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936bb437526a4fdbbcf18dbb29342dc0', 'request_id': 'req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:12.263807 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936bb437526a4fdbbcf18dbb29342dc0', 'request_id': 'req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:12.270631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936bb437526a4fdbbcf18dbb29342dc0', 'request_id': 'req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:12.284447 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] The token cache is being invalidate because project 936bb437526a4fdbbcf18dbb29342dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:12.284767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:12.285836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0bd0a19-2a2a-44f3-8119-c9a13787f3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:12.286962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1397/2790] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:12 2022] DELETE /identity/v3/projects/936bb437526a4fdbbcf18dbb29342dc0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:12.291987 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb6c6-ff3a-439e-ac5a-fbb15eec1cdb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.292468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb6c6-ff3a-439e-ac5a-fbb15eec1cdb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.292588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb6c6-ff3a-439e-ac5a-fbb15eec1cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.313372 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1a4fb6c6-ff3a-439e-ac5a-fbb15eec1cdb None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:12.314581 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a4fb6c6-ff3a-439e-ac5a-fbb15eec1cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:12.384363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1394/2791] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:12.392312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5416a-ae4a-4f3f-b51f-7a92808aa8a9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.392884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5416a-ae4a-4f3f-b51f-7a92808aa8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.393154 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5416a-ae4a-4f3f-b51f-7a92808aa8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.411057 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5ce5416a-ae4a-4f3f-b51f-7a92808aa8a9 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:12.412247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5ce5416a-ae4a-4f3f-b51f-7a92808aa8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:12.420035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1398/2792] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:12.425008 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fb6c6-ff3a-439e-ac5a-fbb15eec1cdb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.430963 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:12.434994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fb6c6-ff3a-439e-ac5a-fbb15eec1cdb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.440558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.441426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.442062 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.442461 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.443200 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:43:12.443492 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.445741 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.460725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1395/2793] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:43:12.463096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5416a-ae4a-4f3f-b51f-7a92808aa8a9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.472873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5416a-ae4a-4f3f-b51f-7a92808aa8a9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.478812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.479549 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.479983 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.480321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.481265 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.483350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.520713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1399/2794] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:43:12 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:12.525019 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.534991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2931c-0c51-441e-998b-f208ed18b9c4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.592418 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.593127 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.593404 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.593669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.594346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.596238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.620943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1396/2795] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:43:12 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:43:12.625132 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.637053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa3400-fb91-4d76-ad65-7543437557bd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.641979 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.642645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.642925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.643196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.643936 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.645572 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.656282 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1400/2796] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:12.660294 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.670649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930e02-8f3b-4e82-bdf6-046ed33796ec admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.675954 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f73ef-44d3-467b-a48f-2c07d9155dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.676608 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f73ef-44d3-467b-a48f-2c07d9155dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.676917 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f73ef-44d3-467b-a48f-2c07d9155dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.677181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f73ef-44d3-467b-a48f-2c07d9155dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.677907 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f73ef-44d3-467b-a48f-2c07d9155dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.679503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f73ef-44d3-467b-a48f-2c07d9155dd5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.689841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1397/2797] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:43:12.693694 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.703916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a483b9d-6eb7-420d-9c3d-f8da83d8aaa3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.708960 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.709839 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.710119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.710445 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] PATH_INFO: `/v3/projects/cedf35fd585743f2893b58a2fda9edff/users/912741d6d24b42d5bf98cf0d2cc8e43d/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.725197 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedf35fd585743f2893b58a2fda9edff, user_id=912741d6d24b42d5bf98cf0d2cc8e43d, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.727917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.743337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1401/2798] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:43:12 2022] PUT /identity/v3/projects/cedf35fd585743f2893b58a2fda9edff/users/912741d6d24b42d5bf98cf0d2cc8e43d/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:43:12.748534 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb46f-e3bb-43b5-b4be-1ed978b7a743 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.748850 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb46f-e3bb-43b5-b4be-1ed978b7a743 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.749144 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb46f-e3bb-43b5-b4be-1ed978b7a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.767599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ea5eb46f-e3bb-43b5-b4be-1ed978b7a743 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:12.768838 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ea5eb46f-e3bb-43b5-b4be-1ed978b7a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:12.825997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1398/2799] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:12.836017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:12.838155 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:12.901192 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483839c-92bc-48ac-b51d-b9a58dc01dc3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:12.905175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:12.905814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:12.906098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:12.906368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:12.916610 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:12.918092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:12.927879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1402/2800] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:13.564678 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e116-abcd-419b-95ed-bd5bae1c50fc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:13.565243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e116-abcd-419b-95ed-bd5bae1c50fc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:13.565243 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e116-abcd-419b-95ed-bd5bae1c50fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:13.593558 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9f21e116-abcd-419b-95ed-bd5bae1c50fc None None] MFA Rules not processed for user `912741d6d24b42d5bf98cf0d2cc8e43d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:13.594964 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9f21e116-abcd-419b-95ed-bd5bae1c50fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:13.662036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:13.666238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1399/2801] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:13.677843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:13.679950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:13.745459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb958-841b-4455-8381-ad0b9ae8dc97 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:13.749031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307f87d-badd-4d47-8971-80992f2eb90a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:13.749684 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307f87d-badd-4d47-8971-80992f2eb90a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:13.749965 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307f87d-badd-4d47-8971-80992f2eb90a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:13.750244 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307f87d-badd-4d47-8971-80992f2eb90a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:13.759083 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307f87d-badd-4d47-8971-80992f2eb90a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:13.760531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307f87d-badd-4d47-8971-80992f2eb90a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:13.769557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1403/2802] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:15.130491 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6ac9a-4f7d-4ca4-986c-0c7e062db307 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:15.131071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6ac9a-4f7d-4ca4-986c-0c7e062db307 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:15.131071 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6ac9a-4f7d-4ca4-986c-0c7e062db307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:15.149502 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a6c6ac9a-4f7d-4ca4-986c-0c7e062db307 None None] MFA Rules not processed for user `912741d6d24b42d5bf98cf0d2cc8e43d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:15.150738 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a6c6ac9a-4f7d-4ca4-986c-0c7e062db307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:15.158389 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1400/2803] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:23.765743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:24.940290 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae72f-bbb5-4ddd-b20c-246f2777f4cf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:24.940968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae72f-bbb5-4ddd-b20c-246f2777f4cf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:24.940968 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae72f-bbb5-4ddd-b20c-246f2777f4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:24.958680 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cebae72f-bbb5-4ddd-b20c-246f2777f4cf None None] MFA Rules not processed for user `1aad8b1af5994d7b9de3a8fb0be556cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:24.959898 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cebae72f-bbb5-4ddd-b20c-246f2777f4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:25.024454 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1404/2804] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:25.143641 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:31.862658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:31.863286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:31.863286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:31.881216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] MFA Rules not processed for user `912741d6d24b42d5bf98cf0d2cc8e43d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:31.882468 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:31.889776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1401/2805] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:43:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:35.016683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=25 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:39.832022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:39.833082 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:39.833542 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:39.851650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:39.852961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:39.909427 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1405/2806] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 12:43:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:39.951661 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:39.953158 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:40.038751 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328f23-cf1f-4778-9131-1e3075e1deb3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:40.048734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:40.049658 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:40.050027 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:40.050430 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:40.061092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:40.062702 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:40.071058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1402/2807] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:43:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:43:47.473163 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:47.474631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:47.491840 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6a61-f4b2-485f-b77d-76f1a4dfa988 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:47.497212 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:47.498093 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:47.498364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:47.498645 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] PATH_INFO: `/v3/users/f725498599d84b3782c0e0d46131463a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:47.500345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f725498599d84b3782c0e0d46131463a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:47.502341 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:47.553256 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f725498599d84b3782c0e0d46131463a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.553939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f725498599d84b3782c0e0d46131463a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.562784 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f725498599d84b3782c0e0d46131463a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.575985 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f725498599d84b3782c0e0d46131463a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.582959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f725498599d84b3782c0e0d46131463a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.589106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1406/2808] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:47 2022] DELETE /identity/v3/users/f725498599d84b3782c0e0d46131463a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:43:47.768858 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:47.779742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20924823-c91f-4e02-a7b7-15a599f8fb08 service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:47.837746 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:47.838605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:47.838878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:47.839146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] PATH_INFO: `/v3/projects/a76f72af8d47404980293788d97edb2e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:47.840339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76f72af8d47404980293788d97edb2e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:47.842266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:47.904626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76f72af8d47404980293788d97edb2e', 'request_id': 'req-d7f140dc-de0e-4731-a507-dba788d534f4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.911082 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76f72af8d47404980293788d97edb2e', 'request_id': 'req-d7f140dc-de0e-4731-a507-dba788d534f4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.917497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76f72af8d47404980293788d97edb2e', 'request_id': 'req-d7f140dc-de0e-4731-a507-dba788d534f4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.931553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] The token cache is being invalidate because project a76f72af8d47404980293788d97edb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:47.931845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.932470 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:47.934087 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1403/2809] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:47 2022] DELETE /identity/v3/projects/a76f72af8d47404980293788d97edb2e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:47.938226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:47.939909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:47.954676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dced41-61dd-48c7-8f83-ce6ad13e9916 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:48.014954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:48.015826 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:48.016089 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:48.016337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] PATH_INFO: `/v3/users/18814e3a85ac487bb9d0b36905b224f2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:48.017609 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18814e3a85ac487bb9d0b36905b224f2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:48.019523 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:48.039822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:48.067560 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18814e3a85ac487bb9d0b36905b224f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.068190 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18814e3a85ac487bb9d0b36905b224f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.076491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18814e3a85ac487bb9d0b36905b224f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.089157 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18814e3a85ac487bb9d0b36905b224f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.100024 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18814e3a85ac487bb9d0b36905b224f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.109101 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1407/2810] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:43:47 2022] DELETE /identity/v3/users/18814e3a85ac487bb9d0b36905b224f2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:48.289854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:48.291117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:48.316723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f140dc-de0e-4731-a507-dba788d534f4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:48.332626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:48.402279 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:48.403147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:48.403426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:48.403695 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] PATH_INFO: `/v3/projects/1685e0ba2e2347a1b68437e886949234` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:48.404946 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1685e0ba2e2347a1b68437e886949234)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:48.406839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:48.458092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1685e0ba2e2347a1b68437e886949234', 'request_id': 'req-8a6fb520-b5a8-47c0-a238-ac57622b4db7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.465691 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1685e0ba2e2347a1b68437e886949234', 'request_id': 'req-8a6fb520-b5a8-47c0-a238-ac57622b4db7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.472600 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1685e0ba2e2347a1b68437e886949234', 'request_id': 'req-8a6fb520-b5a8-47c0-a238-ac57622b4db7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.488690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] The token cache is being invalidate because project 1685e0ba2e2347a1b68437e886949234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:43:48.489030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.489721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8a6fb520-b5a8-47c0-a238-ac57622b4db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:43:48.492671 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1404/2811] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:43:48 2022] DELETE /identity/v3/projects/1685e0ba2e2347a1b68437e886949234 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:43:49.153109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:49.154939 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:49.230390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225964ec-d6a5-4eb6-9818-b254a2bf4397 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:49.301838 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:49.302489 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:49.302771 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:49.303045 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:49.305066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:49.317616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:49.319149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:49.330064 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1408/2812] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:43:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:43:55.911631 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3cb1-fdea-4ce5-b5c3-7fff425600ea None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:55.912100 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3cb1-fdea-4ce5-b5c3-7fff425600ea None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:55.912228 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3cb1-fdea-4ce5-b5c3-7fff425600ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:55.931484 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-527a3cb1-fdea-4ce5-b5c3-7fff425600ea None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:43:55.932733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-527a3cb1-fdea-4ce5-b5c3-7fff425600ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:55.998341 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1405/2813] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 12:43:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:43:56.010675 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:43:56.012332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:43:56.034836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:56.087433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57498-a032-4f80-9cbe-38c665e73c6d service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:43:56.092686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:43:56.093339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:43:56.093612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:43:56.093892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:43:56.103501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:43:56.106041 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:43:56.119430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1409/2814] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:43:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:44:05.987481 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:06.113781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=23 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:10.286733 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:10.287266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:10.287266 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:10.305785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] MFA Rules not processed for user `b0ad031f63ba4d449df8f1f78116a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:44:10.306995 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:10.315236 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1406/2815] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 12:44:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:44:10.327982 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:10.339607 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7b7c2-0f17-4e89-ae31-a6ecebfeb001 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:10.346030 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa37bb31a4fa42d5937b70c993a994fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:10.346673 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:10.346989 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:10.347211 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:10.358933 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:10.360532 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:10.370195 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1410/2816] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 12:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:44:12.407630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:12.409358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:12.474120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152be8b-6dca-4259-93aa-8bbb7065a086 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:12.478997 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:12.479868 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:12.480146 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:12.480416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] PATH_INFO: `/v3/users/912741d6d24b42d5bf98cf0d2cc8e43d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:12.481650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=912741d6d24b42d5bf98cf0d2cc8e43d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:12.483548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:12.532717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912741d6d24b42d5bf98cf0d2cc8e43d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.533368 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912741d6d24b42d5bf98cf0d2cc8e43d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.533959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912741d6d24b42d5bf98cf0d2cc8e43d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.542080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912741d6d24b42d5bf98cf0d2cc8e43d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.554042 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1355dd8c-5ee5-442a-863a-bf9e78e12a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912741d6d24b42d5bf98cf0d2cc8e43d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.566244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1407/2817] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:44:12 2022] DELETE /identity/v3/users/912741d6d24b42d5bf98cf0d2cc8e43d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:44:12.741737 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:12.753031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e5d6d-ec50-45ef-8182-0e8533a39649 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:12.812364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:12.813304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:12.813612 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:12.813884 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] PATH_INFO: `/v3/projects/cedf35fd585743f2893b58a2fda9edff` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:12.815238 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedf35fd585743f2893b58a2fda9edff)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:12.817228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:12.869419 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedf35fd585743f2893b58a2fda9edff', 'request_id': 'req-3e796ada-c8ac-46c2-b973-3dbb18357b8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.876474 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedf35fd585743f2893b58a2fda9edff', 'request_id': 'req-3e796ada-c8ac-46c2-b973-3dbb18357b8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.883435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedf35fd585743f2893b58a2fda9edff', 'request_id': 'req-3e796ada-c8ac-46c2-b973-3dbb18357b8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.899085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] The token cache is being invalidate because project cedf35fd585743f2893b58a2fda9edff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:44:12.899374 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.900000 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3e796ada-c8ac-46c2-b973-3dbb18357b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:12.901571 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1411/2818] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:44:12 2022] DELETE /identity/v3/projects/cedf35fd585743f2893b58a2fda9edff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:44:12.906673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912268-aeb3-4efc-9b5a-4fbdd719254b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:12.906962 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912268-aeb3-4efc-9b5a-4fbdd719254b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:12.907238 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912268-aeb3-4efc-9b5a-4fbdd719254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:12.925414 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b5912268-aeb3-4efc-9b5a-4fbdd719254b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:44:12.926624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b5912268-aeb3-4efc-9b5a-4fbdd719254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:12.989507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1408/2819] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:44:12.998200 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9d67-b209-46b0-b6ef-f5c37e05fd37 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:12.998488 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9d67-b209-46b0-b6ef-f5c37e05fd37 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:12.998757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9d67-b209-46b0-b6ef-f5c37e05fd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.017953 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ab7b9d67-b209-46b0-b6ef-f5c37e05fd37 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:44:13.019188 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ab7b9d67-b209-46b0-b6ef-f5c37e05fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:13.028459 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1412/2820] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:44:13.032908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912268-aeb3-4efc-9b5a-4fbdd719254b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:13.043688 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912268-aeb3-4efc-9b5a-4fbdd719254b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:13.049843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:13.050520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.050800 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.051066 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.051804 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:44:13.052115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:13.053747 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:13.063018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:13.067700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1409/2821] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:44:13.072524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9d67-b209-46b0-b6ef-f5c37e05fd37 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:13.082264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9d67-b209-46b0-b6ef-f5c37e05fd37 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:13.087651 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:13.088295 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.088575 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.088883 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.089567 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:13.091485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:13.120975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1413/2822] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:44:13 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:44:13.125547 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:13.138115 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1382-3b39-4684-8b68-b09041e58c40 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:13.198036 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:13.198700 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.198974 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.199265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.199958 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:13.201906 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:13.224507 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1410/2823] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:44:13 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:44:13.229009 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:13.239239 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6757c0-bab1-4165-80ee-4955b9978463 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:13.244166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:13.244848 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.245126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.245433 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.246162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:13.247764 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:13.259070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1414/2824] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:44:13.263131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:13.273513 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eded23a-9e3c-4a0c-87e9-8d9ed3e66092 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:13.279277 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f304efd-0edd-4ac3-a730-caf88109c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:13.279936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304efd-0edd-4ac3-a730-caf88109c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.280216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304efd-0edd-4ac3-a730-caf88109c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.280487 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f304efd-0edd-4ac3-a730-caf88109c7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.281253 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304efd-0edd-4ac3-a730-caf88109c7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:13.282882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f304efd-0edd-4ac3-a730-caf88109c7d3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:13.293776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1411/2825] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:44:13.299329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:13.309919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc6ac-3c3d-4cc7-969b-f97fa67f2e79 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:13.316923 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:13.318279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.318701 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.319130 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] PATH_INFO: `/v3/projects/6ed0d0a0dbf745298579e77b723b0a74/users/8c00e814b04949e3a5f0d1461e3688ee/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.475162 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed0d0a0dbf745298579e77b723b0a74, user_id=8c00e814b04949e3a5f0d1461e3688ee, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:13.477765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:13.496458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1415/2826] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:44:13 2022] PUT /identity/v3/projects/6ed0d0a0dbf745298579e77b723b0a74/users/8c00e814b04949e3a5f0d1461e3688ee/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:44:13.507586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8959da-0f73-4ccf-b18d-dd316f8454c5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.507586 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8959da-0f73-4ccf-b18d-dd316f8454c5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.508079 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8959da-0f73-4ccf-b18d-dd316f8454c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.535833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9b8959da-0f73-4ccf-b18d-dd316f8454c5 None None] MFA Rules not processed for user `8c00e814b04949e3a5f0d1461e3688ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:44:13.537076 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9b8959da-0f73-4ccf-b18d-dd316f8454c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:13.603409 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1412/2827] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:44:13.614524 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:13.616633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:13.632020 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:13.684046 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10264ac6-3406-4e29-b4b6-cc990545b8f0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:13.689485 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9af2-523c-4fde-8dac-541f8b1286da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:13.690113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9af2-523c-4fde-8dac-541f8b1286da service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:13.690384 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9af2-523c-4fde-8dac-541f8b1286da service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:13.690631 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9af2-523c-4fde-8dac-541f8b1286da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:13.699879 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec9af2-523c-4fde-8dac-541f8b1286da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:13.701349 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec9af2-523c-4fde-8dac-541f8b1286da service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:13.710961 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1416/2828] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:44:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:44:23.600785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:23.706214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=20 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:32.046084 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8959da-0f73-4ccf-b18d-dd316f8454c5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:32.126064 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8959da-0f73-4ccf-b18d-dd316f8454c5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:32.133698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:32.134647 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:32.134944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:32.135271 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] PATH_INFO: `/v3/users/8c00e814b04949e3a5f0d1461e3688ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:32.136500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c00e814b04949e3a5f0d1461e3688ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:32.139573 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:32.195740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c00e814b04949e3a5f0d1461e3688ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.196403 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c00e814b04949e3a5f0d1461e3688ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.197030 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c00e814b04949e3a5f0d1461e3688ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.205774 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c00e814b04949e3a5f0d1461e3688ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.217763 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c00e814b04949e3a5f0d1461e3688ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.229835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1413/2829] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:44:32 2022] DELETE /identity/v3/users/8c00e814b04949e3a5f0d1461e3688ee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:44:32.234493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:32.234980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:32.234980 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:32.253191 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:44:32.254395 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:32.313109 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1417/2830] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:44:32.322817 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:32.324252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:32.386141 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f489f-f8fd-4a54-8bfa-f6242c97ce17 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:32.390527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614ac6-e0ff-41db-8669-19f25b915baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:32.391172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ac6-e0ff-41db-8669-19f25b915baa service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:32.391451 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ac6-e0ff-41db-8669-19f25b915baa service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:32.391717 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ac6-e0ff-41db-8669-19f25b915baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:32.401215 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614ac6-e0ff-41db-8669-19f25b915baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:32.402654 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614ac6-e0ff-41db-8669-19f25b915baa service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:32.412007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1414/2831] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:44:32.691671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:32.693279 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:32.705152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76847f2c-dd69-45b8-aef0-22fb83d75ac6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:32.709881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:32.710762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:32.711034 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:32.711301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] PATH_INFO: `/v3/projects/6ed0d0a0dbf745298579e77b723b0a74` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:32.712557 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed0d0a0dbf745298579e77b723b0a74)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:32.714582 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:32.763467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed0d0a0dbf745298579e77b723b0a74', 'request_id': 'req-ded80620-693c-4d9d-9769-9bee224f635b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.768740 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed0d0a0dbf745298579e77b723b0a74', 'request_id': 'req-ded80620-693c-4d9d-9769-9bee224f635b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.774759 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed0d0a0dbf745298579e77b723b0a74', 'request_id': 'req-ded80620-693c-4d9d-9769-9bee224f635b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.788746 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] The token cache is being invalidate because project 6ed0d0a0dbf745298579e77b723b0a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:44:32.789142 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.789926 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:44:32.791491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1418/2832] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:44:32 2022] DELETE /identity/v3/projects/6ed0d0a0dbf745298579e77b723b0a74 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:44:42.407895 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:42.710178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:42.710458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:42.710728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:42.728596 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] MFA Rules not processed for user `1aad8b1af5994d7b9de3a8fb0be556cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:44:42.729980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:42.785363 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:42.786686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1415/2833] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:44:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:44:43.094252 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:43.096100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:43.160283 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80620-693c-4d9d-9769-9bee224f635b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:43.164749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:43.165403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:43.165683 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:43.165955 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:43.168136 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:43.179032 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:43.180490 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:43.189076 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1419/2834] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:44:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:44:44.536206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:44.537785 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:44.618069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff586d25-d02a-4f48-8080-59a1576d7442 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:44.623548 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:44.624187 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:44.624466 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:44.624766 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:44.626686 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:44.638885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:44.640663 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:44.650544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1416/2835] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:44:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:44:53.185562 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=26 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:54.133226 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:44:54.134687 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:54.210386 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00d0df-7b86-489e-9d74-f94299ff5eb5 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:44:54.216008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d4f967c85db412aacf6c8b441dbdeb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:44:54.216676 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:44:54.216959 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:44:54.217229 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:44:54.219049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:44:54.231016 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:44:54.232597 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:44:54.243422 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1420/2836] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:44:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:44:54.646519 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=57 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:45:04.239037 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=34 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:45:08.125617 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:08.138393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c2a2d-45b2-467a-b89c-049e1b3e3f2d service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:08.146837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec50356-940a-4028-814b-0e8242487786 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:08.147477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec50356-940a-4028-814b-0e8242487786 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:08.147753 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec50356-940a-4028-814b-0e8242487786 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:08.148018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec50356-940a-4028-814b-0e8242487786 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:08.150206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eec50356-940a-4028-814b-0e8242487786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:08.178269 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec50356-940a-4028-814b-0e8242487786 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:08.180690 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec50356-940a-4028-814b-0e8242487786 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:08.194230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1417/2837] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:45:18.189792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=11 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:45:54.048152 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:54.058453 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e534-7388-4e50-9e8b-502b6999efc5 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:54.062327 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:54.062987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:54.063264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:54.063535 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:54.065578 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:54.146922 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:54.148350 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:54.160008 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1421/2838] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:45:55.739304 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec50356-940a-4028-814b-0e8242487786 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:55.740836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eec50356-940a-4028-814b-0e8242487786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:55.754953 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec50356-940a-4028-814b-0e8242487786 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:55.760182 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:55.761103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:55.761386 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:55.761657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] PATH_INFO: `/v3/users/1aad8b1af5994d7b9de3a8fb0be556cf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:55.762950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aad8b1af5994d7b9de3a8fb0be556cf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:55.764912 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:55.815463 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aad8b1af5994d7b9de3a8fb0be556cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:55.816274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aad8b1af5994d7b9de3a8fb0be556cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:55.816956 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aad8b1af5994d7b9de3a8fb0be556cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:55.826480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aad8b1af5994d7b9de3a8fb0be556cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:55.838694 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fff4721f-e1da-47c3-a3e3-85def9d93e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aad8b1af5994d7b9de3a8fb0be556cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:55.853123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1418/2839] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:45:55 2022] DELETE /identity/v3/users/1aad8b1af5994d7b9de3a8fb0be556cf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:45:56.042686 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.053106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89f7e-0262-41a8-8831-ffd54e662837 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.117937 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.118804 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.119085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.119353 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] PATH_INFO: `/v3/projects/0f0a91a3d6a14259b2d03881fdab4f9f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.120584 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0a91a3d6a14259b2d03881fdab4f9f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.122543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.173633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0a91a3d6a14259b2d03881fdab4f9f', 'request_id': 'req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:56.182081 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0a91a3d6a14259b2d03881fdab4f9f', 'request_id': 'req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:56.188518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0a91a3d6a14259b2d03881fdab4f9f', 'request_id': 'req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:56.202502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] The token cache is being invalidate because project 0f0a91a3d6a14259b2d03881fdab4f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:45:56.202831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:56.203400 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c8bafe7-7f62-4f52-8afb-501e6da92a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:45:56.204966 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1422/2840] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:45:56 2022] DELETE /identity/v3/projects/0f0a91a3d6a14259b2d03881fdab4f9f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:45:56.210848 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1977a0f-6798-40b7-bfb9-2c761ef766ad None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.211211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1977a0f-6798-40b7-bfb9-2c761ef766ad None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.211482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1977a0f-6798-40b7-bfb9-2c761ef766ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.230358 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d1977a0f-6798-40b7-bfb9-2c761ef766ad None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:45:56.231546 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d1977a0f-6798-40b7-bfb9-2c761ef766ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:56.291440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1419/2841] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:45:56.300219 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6144d5-49bc-4bfc-ad46-de50ff7278d3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.300499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6144d5-49bc-4bfc-ad46-de50ff7278d3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.300806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6144d5-49bc-4bfc-ad46-de50ff7278d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.321636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7a6144d5-49bc-4bfc-ad46-de50ff7278d3 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:45:56.322831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a6144d5-49bc-4bfc-ad46-de50ff7278d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:56.331890 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1423/2842] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:45:56.335957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1977a0f-6798-40b7-bfb9-2c761ef766ad None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.346319 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1977a0f-6798-40b7-bfb9-2c761ef766ad None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.351564 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.352229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.352527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.352845 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.353597 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:45:56.353897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.355482 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.369452 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1420/2843] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:45:56.375987 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6144d5-49bc-4bfc-ad46-de50ff7278d3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.390294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6144d5-49bc-4bfc-ad46-de50ff7278d3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.397079 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.397814 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.398263 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.398710 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.400246 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.402169 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.417416 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:45:56.436962 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1424/2844] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:45:56 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:45:56.439908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.450450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019fa18-bd3d-4e4f-a526-05a9dd200f5b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.516346 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.517237 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.517541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.517812 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.518497 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.520416 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.527172 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:45:56.542665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1421/2845] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:45:56 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:45:56.546856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.557822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da02a51-8511-455f-b3e9-059c0f3fbb9f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.562626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.563271 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.563545 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.563950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.564699 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.566335 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.576629 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1425/2846] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:45:56.580610 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.591979 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f479-3078-41b4-ac04-8f825d4005f7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.597559 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bc3d9-b345-4d2a-ba94-d4f2ae9c12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.598224 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bc3d9-b345-4d2a-ba94-d4f2ae9c12b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.598503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bc3d9-b345-4d2a-ba94-d4f2ae9c12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.598777 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bc3d9-b345-4d2a-ba94-d4f2ae9c12b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.599506 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bc3d9-b345-4d2a-ba94-d4f2ae9c12b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.601149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bc3d9-b345-4d2a-ba94-d4f2ae9c12b5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.611259 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1422/2847] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:45:56.615790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.625889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6ffd7-8159-4b5c-b148-155e2ad87a12 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.630808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.631818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.632098 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.632362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] PATH_INFO: `/v3/projects/3cf7ad639ac6488cb367c9d2b5f18d05/users/d94f884521af4c06b3ed324f2f28215e/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.647458 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7ad639ac6488cb367c9d2b5f18d05, user_id=d94f884521af4c06b3ed324f2f28215e, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.650213 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.665722 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1426/2848] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:45:56 2022] PUT /identity/v3/projects/3cf7ad639ac6488cb367c9d2b5f18d05/users/d94f884521af4c06b3ed324f2f28215e/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:45:56.676230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e54d-86e2-47d0-9ffc-b102e9a81c41 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.676509 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e54d-86e2-47d0-9ffc-b102e9a81c41 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.676843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e54d-86e2-47d0-9ffc-b102e9a81c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.713203 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bed6e54d-86e2-47d0-9ffc-b102e9a81c41 None None] MFA Rules not processed for user `d94f884521af4c06b3ed324f2f28215e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:45:56.714955 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bed6e54d-86e2-47d0-9ffc-b102e9a81c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:56.787669 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1423/2849] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:45:56.792464 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.856555 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5283-2deb-445a-9d95-657a1cf164f7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.862428 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.863100 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.863381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.863650 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.864293 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.866248 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:56.893852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1427/2850] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:45:56 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:45:56.898723 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6e54d-86e2-47d0-9ffc-b102e9a81c41 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:56.910646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6e54d-86e2-47d0-9ffc-b102e9a81c41 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:56.978245 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:56.978862 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:56.979134 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:56.979401 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:56.980080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:56.982080 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:57.003018 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1424/2851] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:45:56 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:45:57.007202 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:57.018183 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6646f92-0af8-4b16-a22c-9ff811113e3c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:57.023518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:57.024241 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:57.024518 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:57.024842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:57.025545 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:57.027138 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:57.037706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1428/2852] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:45:57.041759 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:57.051756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b30125-77ae-475f-aa76-9f5e01d50bfb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:57.056959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:57.057883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:57.058188 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:57.058434 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] PATH_INFO: `/v3/projects/4729384342eb4ca5bb680c111604d3f3/users/009fbd4b32094bac968ef38e863b285a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:57.075056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4729384342eb4ca5bb680c111604d3f3, user_id=009fbd4b32094bac968ef38e863b285a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:57.077811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:57.092703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1425/2853] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:45:57 2022] PUT /identity/v3/projects/4729384342eb4ca5bb680c111604d3f3/users/009fbd4b32094bac968ef38e863b285a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:45:57.097383 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:57.107917 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253d6c-3c00-4ae3-9162-80f4ea6358ac admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:57.172351 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d85738-24ed-4f02-9959-56a7160a4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:57.173044 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85738-24ed-4f02-9959-56a7160a4566 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:57.173312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85738-24ed-4f02-9959-56a7160a4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:57.173602 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85738-24ed-4f02-9959-56a7160a4566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:57.174339 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d85738-24ed-4f02-9959-56a7160a4566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:57.176063 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d85738-24ed-4f02-9959-56a7160a4566 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:57.186123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1429/2854] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:45:57.190575 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:57.201204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85989108-9e4e-4ea4-85fe-09ed138853c2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:57.206262 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:57.207145 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:57.207423 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:57.207693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] PATH_INFO: `/v3/projects/4729384342eb4ca5bb680c111604d3f3/users/009fbd4b32094bac968ef38e863b285a/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:57.209756 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4729384342eb4ca5bb680c111604d3f3, user_id=009fbd4b32094bac968ef38e863b285a, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:57.212517 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:57.224003 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1426/2855] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:45:57 2022] PUT /identity/v3/projects/4729384342eb4ca5bb680c111604d3f3/users/009fbd4b32094bac968ef38e863b285a/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:45:57.241614 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:57.241828 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:57.242106 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:57.269499 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] MFA Rules not processed for user `009fbd4b32094bac968ef38e863b285a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:45:57.270724 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:57.289056 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:45:57.342880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1430/2856] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:45:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:45:57.354900 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:57.356972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:57.380552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:45:57.417983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663d17-36cb-42a8-86c5-339d19ffc823 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:57.422181 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:57.422792 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:57.423072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:57.423342 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:57.433083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:57.434510 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:57.444130 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1427/2857] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:45:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:45:57.497819 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:45:57.499735 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:45:57.512749 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9966-d2b2-4f27-8533-06a2798b3cff None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:45:57.516743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967cd85-fe03-4546-92a6-bee421765f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:45:57.517346 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cd85-fe03-4546-92a6-bee421765f2b service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:45:57.517641 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cd85-fe03-4546-92a6-bee421765f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:45:57.517889 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967cd85-fe03-4546-92a6-bee421765f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:45:57.576105 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967cd85-fe03-4546-92a6-bee421765f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:45:57.577275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967cd85-fe03-4546-92a6-bee421765f2b service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:45:57.588332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1431/2858] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:45:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:00.939576 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:01.003170 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc639c1-c5e5-418d-b753-d0c86c19a34d service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:01.009462 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:01.010334 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:01.010612 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:01.010882 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] PATH_INFO: `/v3/users/d94f884521af4c06b3ed324f2f28215e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:01.012233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94f884521af4c06b3ed324f2f28215e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:01.014210 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:01.071438 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94f884521af4c06b3ed324f2f28215e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.072163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94f884521af4c06b3ed324f2f28215e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.072860 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94f884521af4c06b3ed324f2f28215e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.082288 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94f884521af4c06b3ed324f2f28215e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.094400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94f884521af4c06b3ed324f2f28215e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.107221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1428/2859] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:46:00 2022] DELETE /identity/v3/users/d94f884521af4c06b3ed324f2f28215e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:01.111908 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:01.112802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:01.112802 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:01.130443 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:01.131621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:01.202506 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1432/2860] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:01.214058 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:01.216239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:01.270015 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:01.285659 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d50bb1-3b89-4547-8c62-dc379a3582ba admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:01.290209 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:01.290885 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:01.291171 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:01.291445 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:01.300854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:01.302315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:01.311856 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1429/2861] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:01.872376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:01.874003 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:01.888062 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceacd06-27c4-40b8-9984-c2a8944c8b85 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:01.894196 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:01.895176 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:01.895920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:01.895920 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] PATH_INFO: `/v3/projects/3cf7ad639ac6488cb367c9d2b5f18d05` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:01.897403 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf7ad639ac6488cb367c9d2b5f18d05)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:01.899409 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:01.952586 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf7ad639ac6488cb367c9d2b5f18d05', 'request_id': 'req-8f03ff6b-c143-4249-aaea-c47c90c27ff9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.953864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:01.960031 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf7ad639ac6488cb367c9d2b5f18d05', 'request_id': 'req-8f03ff6b-c143-4249-aaea-c47c90c27ff9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.967866 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf7ad639ac6488cb367c9d2b5f18d05', 'request_id': 'req-8f03ff6b-c143-4249-aaea-c47c90c27ff9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.981734 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] The token cache is being invalidate because project 3cf7ad639ac6488cb367c9d2b5f18d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:46:01.982017 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.982626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:01.984187 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1433/2862] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:46:01 2022] DELETE /identity/v3/projects/3cf7ad639ac6488cb367c9d2b5f18d05 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:01.988585 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:01.998467 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020378-27c7-4dc5-92a2-677f395b55da service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:02.055630 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:02.056493 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.056813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.057085 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] PATH_INFO: `/v3/users/009fbd4b32094bac968ef38e863b285a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.058369 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=009fbd4b32094bac968ef38e863b285a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:02.060344 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:02.113645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009fbd4b32094bac968ef38e863b285a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.114359 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009fbd4b32094bac968ef38e863b285a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.114982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009fbd4b32094bac968ef38e863b285a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.123837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009fbd4b32094bac968ef38e863b285a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.136878 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5e46d0a7-3251-4fd4-81f1-096eca16efbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009fbd4b32094bac968ef38e863b285a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.149846 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1430/2863] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:46:01 2022] DELETE /identity/v3/users/009fbd4b32094bac968ef38e863b285a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:02.430806 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:02.432275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:02.445502 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ff6b-c143-4249-aaea-c47c90c27ff9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:02.514636 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:02.515530 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.515845 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.516134 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] PATH_INFO: `/v3/projects/4729384342eb4ca5bb680c111604d3f3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.517577 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4729384342eb4ca5bb680c111604d3f3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:02.519671 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:02.576738 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4729384342eb4ca5bb680c111604d3f3', 'request_id': 'req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.582418 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4729384342eb4ca5bb680c111604d3f3', 'request_id': 'req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.588856 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4729384342eb4ca5bb680c111604d3f3', 'request_id': 'req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.605663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] The token cache is being invalidate because project 4729384342eb4ca5bb680c111604d3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:46:02.605663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.605663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ab4511e4-d576-41ae-a0d8-c17b850e2ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:02.606179 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1434/2864] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:46:02 2022] DELETE /identity/v3/projects/4729384342eb4ca5bb680c111604d3f3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:02.613229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831c9ec-17c1-44dc-9972-943293fd6b6e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.613544 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831c9ec-17c1-44dc-9972-943293fd6b6e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.613833 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831c9ec-17c1-44dc-9972-943293fd6b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.634601 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c831c9ec-17c1-44dc-9972-943293fd6b6e None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:02.635949 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c831c9ec-17c1-44dc-9972-943293fd6b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:02.697164 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1431/2865] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:46:02.708463 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3552ee-3f2e-4642-8d77-f3f333d87bed None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.708791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3552ee-3f2e-4642-8d77-f3f333d87bed None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.709069 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3552ee-3f2e-4642-8d77-f3f333d87bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.731852 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8c3552ee-3f2e-4642-8d77-f3f333d87bed None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:02.733096 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c3552ee-3f2e-4642-8d77-f3f333d87bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:02.743850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1435/2866] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:02.748972 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831c9ec-17c1-44dc-9972-943293fd6b6e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:02.758490 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:02.762891 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831c9ec-17c1-44dc-9972-943293fd6b6e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:02.769553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:02.770205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.770489 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.770796 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.771524 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:46:02.771854 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:02.774488 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:02.787088 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1432/2867] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:46:02.792133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3552ee-3f2e-4642-8d77-f3f333d87bed None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:02.802141 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3552ee-3f2e-4642-8d77-f3f333d87bed None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:02.807950 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:02.808625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.808932 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.809204 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.809925 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:02.811906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:02.840153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1436/2868] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:46:02 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:46:02.844435 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:02.854718 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2ff9-5906-43dd-b68f-455f2d87af8e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:02.912075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:02.912665 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.912971 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.913206 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.913950 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:02.915951 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:02.938230 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1433/2869] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:46:02 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:46:02.941627 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:02.952273 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d1394-2313-4716-9f2a-9fe6ce10c67c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:02.957112 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:02.957765 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.958042 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.958312 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.959043 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:02.960667 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:02.971836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1437/2870] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:02.976000 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:02.986595 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1f3d2-7446-445e-a35f-c61ef6970fdf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:02.992660 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1593174-2a8d-430c-af8b-bda70f410000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:02.993408 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1593174-2a8d-430c-af8b-bda70f410000 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:02.993682 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1593174-2a8d-430c-af8b-bda70f410000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:02.993945 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1593174-2a8d-430c-af8b-bda70f410000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:02.994685 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1593174-2a8d-430c-af8b-bda70f410000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:02.996265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1593174-2a8d-430c-af8b-bda70f410000 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.006716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1434/2871] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:46:03.011376 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.021743 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3edacc-f8d8-4e69-ae31-7895007eb701 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.026946 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.027836 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.028113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.028382 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] PATH_INFO: `/v3/projects/ac02e62e362145bd9658564b6b659982/users/a6da4c499664418e8070e0ec3187506f/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.044332 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac02e62e362145bd9658564b6b659982, user_id=a6da4c499664418e8070e0ec3187506f, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.047028 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.064145 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1438/2872] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:46:03 2022] PUT /identity/v3/projects/ac02e62e362145bd9658564b6b659982/users/a6da4c499664418e8070e0ec3187506f/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:46:03.074673 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626961b-5a58-4aef-b08f-fb8e0b070dbd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.074959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626961b-5a58-4aef-b08f-fb8e0b070dbd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.075239 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626961b-5a58-4aef-b08f-fb8e0b070dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.102426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a626961b-5a58-4aef-b08f-fb8e0b070dbd None None] MFA Rules not processed for user `a6da4c499664418e8070e0ec3187506f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:03.104048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a626961b-5a58-4aef-b08f-fb8e0b070dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:03.175260 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1435/2873] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:03.180431 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.189387 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:03.261288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca99ae-6f98-48e0-9102-4ac708d6108f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.267357 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.268040 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.268317 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.268576 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.269321 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.271286 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.299222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1439/2874] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:46:03 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:46:03.304072 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626961b-5a58-4aef-b08f-fb8e0b070dbd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.316091 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626961b-5a58-4aef-b08f-fb8e0b070dbd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.375836 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.376653 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.376944 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.377216 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.377947 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.379991 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.387538 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:03.404759 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1436/2875] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:46:03 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:46:03.409255 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.419842 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e61f6-44f1-4cbe-aba6-dfc34a652780 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.424808 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.425516 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.425732 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.425999 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.426725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.428318 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.438730 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1440/2876] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:03.443246 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.454349 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd982ef2-cfc9-4c27-8011-800ba57311cd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.459424 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.460305 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.460588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.460894 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] PATH_INFO: `/v3/projects/b9454d04caa24442bc0a0a73396dfb8a/users/b5f416c365394c63a47126836a3c8b69/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.477961 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9454d04caa24442bc0a0a73396dfb8a, user_id=b5f416c365394c63a47126836a3c8b69, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.480734 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.496664 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1437/2877] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:46:03 2022] PUT /identity/v3/projects/b9454d04caa24442bc0a0a73396dfb8a/users/b5f416c365394c63a47126836a3c8b69/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:03.501381 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.512025 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ca78-845a-43aa-b342-2bec9066b95a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.570812 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb62d0-9386-4c46-91c6-6d0a73e48a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.571543 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb62d0-9386-4c46-91c6-6d0a73e48a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.571818 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb62d0-9386-4c46-91c6-6d0a73e48a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.572090 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb62d0-9386-4c46-91c6-6d0a73e48a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.572870 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb62d0-9386-4c46-91c6-6d0a73e48a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.574512 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb62d0-9386-4c46-91c6-6d0a73e48a82 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.584390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1441/2878] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:03.589117 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.600221 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef49ab-829d-45a6-b9a7-898e6d99894c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.605897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.606815 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.607095 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.607347 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] PATH_INFO: `/v3/projects/b9454d04caa24442bc0a0a73396dfb8a/users/b5f416c365394c63a47126836a3c8b69/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.609453 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9454d04caa24442bc0a0a73396dfb8a, user_id=b5f416c365394c63a47126836a3c8b69, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.612419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.623795 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1438/2879] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:46:03 2022] PUT /identity/v3/projects/b9454d04caa24442bc0a0a73396dfb8a/users/b5f416c365394c63a47126836a3c8b69/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:03.685776 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda503-cdc1-4bcc-9c87-ee900f3942c1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.685976 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda503-cdc1-4bcc-9c87-ee900f3942c1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.686364 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda503-cdc1-4bcc-9c87-ee900f3942c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.724122 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-42eda503-cdc1-4bcc-9c87-ee900f3942c1 None None] MFA Rules not processed for user `b5f416c365394c63a47126836a3c8b69`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:03.725393 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42eda503-cdc1-4bcc-9c87-ee900f3942c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:03.798876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:03.803337 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1442/2880] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:03.814651 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:03.816518 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:03.878147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ac3ec-2429-4b6f-836b-04dece84f2ac admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:03.882363 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797b413-ff8d-48cb-bff2-06c8030a897b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:03.882998 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797b413-ff8d-48cb-bff2-06c8030a897b service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:03.883241 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797b413-ff8d-48cb-bff2-06c8030a897b service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:03.883537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797b413-ff8d-48cb-bff2-06c8030a897b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:03.894265 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797b413-ff8d-48cb-bff2-06c8030a897b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:03.895692 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797b413-ff8d-48cb-bff2-06c8030a897b service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:03.905681 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1439/2881] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:04.036284 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda503-cdc1-4bcc-9c87-ee900f3942c1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:04.102435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda503-cdc1-4bcc-9c87-ee900f3942c1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:04.108151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:04.109184 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:04.109498 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:04.109713 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] PATH_INFO: `/v3/users/a6da4c499664418e8070e0ec3187506f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:04.111049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6da4c499664418e8070e0ec3187506f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:04.113397 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:04.165531 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6da4c499664418e8070e0ec3187506f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.166177 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6da4c499664418e8070e0ec3187506f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.173706 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6da4c499664418e8070e0ec3187506f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.185691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6da4c499664418e8070e0ec3187506f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.193035 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6da4c499664418e8070e0ec3187506f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.199510 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1443/2882] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:46:04 2022] DELETE /identity/v3/users/a6da4c499664418e8070e0ec3187506f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:04.204427 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:04.204943 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:04.205024 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:04.228483 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:04.229728 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:04.292450 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1440/2883] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:04.304050 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:04.306371 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:04.381467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfaaa-d400-493f-b030-f031083940cb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:04.385456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:04.386087 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:04.386360 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:04.386625 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:04.395876 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:04.397338 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:04.409590 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1444/2884] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:04.683587 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:04.685121 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:04.698649 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d3bfe-6e7a-4b57-ae5f-9454077674dd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:04.705068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:04.705914 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:04.706286 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:04.706458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] PATH_INFO: `/v3/projects/ac02e62e362145bd9658564b6b659982` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:04.707761 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac02e62e362145bd9658564b6b659982)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:04.709797 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:04.762835 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac02e62e362145bd9658564b6b659982', 'request_id': 'req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.763937 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:04.769537 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac02e62e362145bd9658564b6b659982', 'request_id': 'req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.776419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac02e62e362145bd9658564b6b659982', 'request_id': 'req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.791837 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] The token cache is being invalidate because project ac02e62e362145bd9658564b6b659982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:46:04.792123 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.792898 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.794657 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1441/2885] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:46:04 2022] DELETE /identity/v3/projects/ac02e62e362145bd9658564b6b659982 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:04.798790 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:04.812822 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17184c-054a-4e9f-a74b-49d209cae3fa service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:04.835018 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:04.875462 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:04.876329 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:04.876604 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:04.876905 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] PATH_INFO: `/v3/users/b5f416c365394c63a47126836a3c8b69` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:04.878071 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f416c365394c63a47126836a3c8b69)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:04.880005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:04.936214 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f416c365394c63a47126836a3c8b69'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.936915 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f416c365394c63a47126836a3c8b69'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.947165 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f416c365394c63a47126836a3c8b69'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.960251 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f416c365394c63a47126836a3c8b69'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.967234 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c9ad3517-3c9e-4e6a-895a-90e62c00c545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f416c365394c63a47126836a3c8b69'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:04.973362 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1445/2886] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:46:04 2022] DELETE /identity/v3/users/b5f416c365394c63a47126836a3c8b69 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:05.268982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:05.270472 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:05.283988 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67a22-b2b4-4b01-91af-226fd8d37e7b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:05.344289 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:05.345149 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.345429 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.345698 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] PATH_INFO: `/v3/projects/b9454d04caa24442bc0a0a73396dfb8a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.346864 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9454d04caa24442bc0a0a73396dfb8a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:05.348818 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:05.403703 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9454d04caa24442bc0a0a73396dfb8a', 'request_id': 'req-9038e53c-6a8d-47a2-8782-e256f8e5d06e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:05.410646 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9454d04caa24442bc0a0a73396dfb8a', 'request_id': 'req-9038e53c-6a8d-47a2-8782-e256f8e5d06e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:05.417211 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9454d04caa24442bc0a0a73396dfb8a', 'request_id': 'req-9038e53c-6a8d-47a2-8782-e256f8e5d06e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:05.432035 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] The token cache is being invalidate because project b9454d04caa24442bc0a0a73396dfb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:46:05.432315 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:05.432935 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9038e53c-6a8d-47a2-8782-e256f8e5d06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:05.434624 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1442/2887] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:46:05 2022] DELETE /identity/v3/projects/b9454d04caa24442bc0a0a73396dfb8a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:05.440372 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb8036-f92b-47e1-8af4-9294f86efa9b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.440762 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb8036-f92b-47e1-8af4-9294f86efa9b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.441060 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb8036-f92b-47e1-8af4-9294f86efa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.466733 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aabb8036-f92b-47e1-8af4-9294f86efa9b None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:05.467929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aabb8036-f92b-47e1-8af4-9294f86efa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:05.531022 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1446/2888] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:05.539980 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3c70d-3e5c-455a-9395-9b099d7dbcef None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.540353 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3c70d-3e5c-455a-9395-9b099d7dbcef None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.540893 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3c70d-3e5c-455a-9395-9b099d7dbcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.570811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-20a3c70d-3e5c-455a-9395-9b099d7dbcef None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:05.572233 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-20a3c70d-3e5c-455a-9395-9b099d7dbcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:05.584485 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1443/2889] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:05.591603 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb8036-f92b-47e1-8af4-9294f86efa9b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:05.602747 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb8036-f92b-47e1-8af4-9294f86efa9b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:05.608085 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:05.608867 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.609147 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.609415 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.610149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:46:05.610452 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:05.612456 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:05.624658 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1447/2890] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:46:05.629802 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3c70d-3e5c-455a-9395-9b099d7dbcef None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:05.641323 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3c70d-3e5c-455a-9395-9b099d7dbcef None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:05.646716 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:05.647364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.647640 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.647919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.648599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:05.650512 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:05.681083 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1444/2891] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:46:05 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:46:05.682626 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:05.693691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549416-f8fc-41c8-bf10-922945e6f685 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:05.720270 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:05.755175 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:05.755854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.756133 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.756405 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.757153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:05.759140 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:05.780704 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1448/2892] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:46:05 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:46:05.785021 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:05.795252 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b857-d768-4b3f-8b57-8003abb234c8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:05.800109 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:05.800793 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.801069 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.801339 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.802059 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:05.803648 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:05.814813 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1445/2893] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:46:05.818829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:05.829744 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7395e-0992-49a9-a3a9-68c619747e4c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:05.835323 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17c5d-7629-45ba-b9f9-9b47e6930969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:05.835984 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17c5d-7629-45ba-b9f9-9b47e6930969 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.836264 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17c5d-7629-45ba-b9f9-9b47e6930969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.836536 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17c5d-7629-45ba-b9f9-9b47e6930969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.837304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17c5d-7629-45ba-b9f9-9b47e6930969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:05.839006 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17c5d-7629-45ba-b9f9-9b47e6930969 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:05.849390 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1449/2894] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:05.853553 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:05.863983 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3619-8a34-4f8c-a770-1b40dc129665 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:05.869034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:05.869908 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.870183 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.870480 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] PATH_INFO: `/v3/projects/3c7c3e78370041eca356ba3b9596ce6d/users/511e969264dd4b539e8d5ebeb2c4a333/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.886168 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7c3e78370041eca356ba3b9596ce6d, user_id=511e969264dd4b539e8d5ebeb2c4a333, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:05.888839 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:05.907970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1446/2895] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:46:05 2022] PUT /identity/v3/projects/3c7c3e78370041eca356ba3b9596ce6d/users/511e969264dd4b539e8d5ebeb2c4a333/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:05.920481 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c4f05-b674-4a12-bca1-57933ef5483b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:05.920880 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c4f05-b674-4a12-bca1-57933ef5483b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:05.921222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c4f05-b674-4a12-bca1-57933ef5483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:05.951491 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3b9c4f05-b674-4a12-bca1-57933ef5483b None None] MFA Rules not processed for user `511e969264dd4b539e8d5ebeb2c4a333`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:05.952757 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3b9c4f05-b674-4a12-bca1-57933ef5483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:06.016621 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1450/2896] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:06.021184 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.027399 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:06.088163 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8d1de-29f6-46d5-ae24-f2cfbc7ae886 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.092959 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.093605 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.093881 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.094153 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.094829 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.096715 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.122599 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1447/2897] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:46:06 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:46:06.126639 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c4f05-b674-4a12-bca1-57933ef5483b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.137493 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c4f05-b674-4a12-bca1-57933ef5483b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.194277 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.194924 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.195199 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.195467 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.196151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.198146 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.220053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1451/2898] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:46:06 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:46:06.224327 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.235033 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea348f6-8287-468d-9fc7-859814bb8121 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.240400 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.241075 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.241351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.241626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.242351 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.243923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.254500 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1448/2899] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:06.259070 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.274119 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127aa93-51bf-41b6-87ce-c5c0963e6a51 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.281430 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034148-6975-4193-9286-49d259895765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.282700 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034148-6975-4193-9286-49d259895765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.282995 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034148-6975-4193-9286-49d259895765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.283345 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034148-6975-4193-9286-49d259895765 admin admin] PATH_INFO: `/v3/projects/9f33e239b89145069724088368ed4d47/users/554fe25b1b2d453bb519e7a3773223f8/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.300725 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57034148-6975-4193-9286-49d259895765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f33e239b89145069724088368ed4d47, user_id=554fe25b1b2d453bb519e7a3773223f8, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.303368 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57034148-6975-4193-9286-49d259895765 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.322342 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1452/2900] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:46:06 2022] PUT /identity/v3/projects/9f33e239b89145069724088368ed4d47/users/554fe25b1b2d453bb519e7a3773223f8/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:06.326364 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.336712 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b27eeb-4c2b-47a0-b244-3cf2cfa43e21 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.396321 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284db32d-49d7-4953-8549-c80cd042c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.396925 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db32d-49d7-4953-8549-c80cd042c46c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.397202 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db32d-49d7-4953-8549-c80cd042c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.397477 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db32d-49d7-4953-8549-c80cd042c46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.398194 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284db32d-49d7-4953-8549-c80cd042c46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.399779 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284db32d-49d7-4953-8549-c80cd042c46c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.409783 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1449/2901] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:06.414501 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034148-6975-4193-9286-49d259895765 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.420301 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:06.426304 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034148-6975-4193-9286-49d259895765 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.432166 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.433113 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.433653 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.433927 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] PATH_INFO: `/v3/projects/9f33e239b89145069724088368ed4d47/users/554fe25b1b2d453bb519e7a3773223f8/roles/aafa433396f14143bb549af1f2b6219b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.436015 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f33e239b89145069724088368ed4d47, user_id=554fe25b1b2d453bb519e7a3773223f8, role_id=aafa433396f14143bb549af1f2b6219b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.438692 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.449259 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1453/2902] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:46:06 2022] PUT /identity/v3/projects/9f33e239b89145069724088368ed4d47/users/554fe25b1b2d453bb519e7a3773223f8/roles/aafa433396f14143bb549af1f2b6219b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:06.460670 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78c5d-6691-49f1-9515-4197cd474685 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.460970 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78c5d-6691-49f1-9515-4197cd474685 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.461244 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78c5d-6691-49f1-9515-4197cd474685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.489542 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8da78c5d-6691-49f1-9515-4197cd474685 None None] MFA Rules not processed for user `554fe25b1b2d453bb519e7a3773223f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:06.490776 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8da78c5d-6691-49f1-9515-4197cd474685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:06.562014 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:06.567114 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1450/2903] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:06.578873 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.580821 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:06.644266 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31854fca-3cd5-41d1-8a69-2a6bac969e6f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.647903 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.648472 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.648781 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.649053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.657829 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.659247 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.670153 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1454/2904] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:06.757007 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da78c5d-6691-49f1-9515-4197cd474685 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:06.766975 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da78c5d-6691-49f1-9515-4197cd474685 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:06.771174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4243a7e-f604-4c9f-b5b0-bc95443e0718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8935a1ea9f94443f903d479401706473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:06.771843 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4243a7e-f604-4c9f-b5b0-bc95443e0718 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:06.772147 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4243a7e-f604-4c9f-b5b0-bc95443e0718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:06.772496 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4243a7e-f604-4c9f-b5b0-bc95443e0718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:06.841287 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4243a7e-f604-4c9f-b5b0-bc95443e0718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:06.842737 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4243a7e-f604-4c9f-b5b0-bc95443e0718 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:06.852068 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1451/2905] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:11.636947 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:11.700158 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac9b97-621f-4fd8-9daa-292c5dddca3a service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:11.704997 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:11.705854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:11.706126 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:11.706424 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] PATH_INFO: `/v3/users/511e969264dd4b539e8d5ebeb2c4a333` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:11.707633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=511e969264dd4b539e8d5ebeb2c4a333)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:11.709579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:11.757292 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511e969264dd4b539e8d5ebeb2c4a333'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:11.757916 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511e969264dd4b539e8d5ebeb2c4a333'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:11.766280 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511e969264dd4b539e8d5ebeb2c4a333'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:11.778092 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511e969264dd4b539e8d5ebeb2c4a333'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:11.784975 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511e969264dd4b539e8d5ebeb2c4a333'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:11.791805 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1455/2906] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:46:11 2022] DELETE /identity/v3/users/511e969264dd4b539e8d5ebeb2c4a333 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:11.796367 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:11.796883 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:11.796968 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:11.815111 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:11.816311 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:11.876174 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1452/2907] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:11.887412 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:11.888896 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:11.904225 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:11.959228 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b6036-0960-4ee4-807b-7ef50aca42e3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:11.963534 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:11.964269 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:11.964583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:11.964888 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:11.974654 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:11.976123 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:11.985886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1456/2908] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:12.258140 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:12.261820 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:12.282505 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37377269-fdc9-46d8-b445-ebd747a4e3b8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:12.289966 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:12.290875 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:12.291154 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:12.291531 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] PATH_INFO: `/v3/projects/3c7c3e78370041eca356ba3b9596ce6d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:12.292758 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7c3e78370041eca356ba3b9596ce6d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:12.294811 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:12.341469 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7c3e78370041eca356ba3b9596ce6d', 'request_id': 'req-d0f213a9-325e-4de8-9383-fa8337b06daf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.346965 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7c3e78370041eca356ba3b9596ce6d', 'request_id': 'req-d0f213a9-325e-4de8-9383-fa8337b06daf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.352999 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7c3e78370041eca356ba3b9596ce6d', 'request_id': 'req-d0f213a9-325e-4de8-9383-fa8337b06daf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.367112 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] The token cache is being invalidate because project 3c7c3e78370041eca356ba3b9596ce6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:46:12.367393 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.368028 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.369588 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1453/2909] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:46:12 2022] DELETE /identity/v3/projects/3c7c3e78370041eca356ba3b9596ce6d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:12.373633 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:12.383439 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b043344-aca5-4ee5-978e-0325cdc2bd6e service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:12.440322 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:12.441254 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:12.441529 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:12.441795 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] PATH_INFO: `/v3/users/554fe25b1b2d453bb519e7a3773223f8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:12.443072 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554fe25b1b2d453bb519e7a3773223f8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:12.445053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:12.496224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554fe25b1b2d453bb519e7a3773223f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.496881 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554fe25b1b2d453bb519e7a3773223f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.506002 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554fe25b1b2d453bb519e7a3773223f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.519161 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554fe25b1b2d453bb519e7a3773223f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.525919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38fadb00-ad9d-4e66-ae5b-64d00d3d6cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554fe25b1b2d453bb519e7a3773223f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.531843 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1457/2910] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:46:12 2022] DELETE /identity/v3/users/554fe25b1b2d453bb519e7a3773223f8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:12.822821 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:12.825048 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:12.839701 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f213a9-325e-4de8-9383-fa8337b06daf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:12.866043 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:12.906103 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:12.906982 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:12.907229 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:12.907520 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] PATH_INFO: `/v3/projects/9f33e239b89145069724088368ed4d47` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:12.908740 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f33e239b89145069724088368ed4d47)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:12.910650 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:12.958494 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f33e239b89145069724088368ed4d47', 'request_id': 'req-73e3ffdb-f1af-4b21-8ec8-f19364febc08'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.963957 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f33e239b89145069724088368ed4d47', 'request_id': 'req-73e3ffdb-f1af-4b21-8ec8-f19364febc08'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.970234 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f33e239b89145069724088368ed4d47', 'request_id': 'req-73e3ffdb-f1af-4b21-8ec8-f19364febc08'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.985788 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] The token cache is being invalidate because project 9f33e239b89145069724088368ed4d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:46:12.986092 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.987001 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-73e3ffdb-f1af-4b21-8ec8-f19364febc08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:12.988511 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1454/2911] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:46:12 2022] DELETE /identity/v3/projects/9f33e239b89145069724088368ed4d47 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:12.993618 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27067f1-b91f-4aec-95d1-a78d46957299 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:12.994066 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27067f1-b91f-4aec-95d1-a78d46957299 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:12.994149 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27067f1-b91f-4aec-95d1-a78d46957299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.013222 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f27067f1-b91f-4aec-95d1-a78d46957299 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:13.014520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f27067f1-b91f-4aec-95d1-a78d46957299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:13.045623 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:13.079906 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1458/2912] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:13.087742 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f6e5-6310-4001-b6f1-48755cceac25 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.088052 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f6e5-6310-4001-b6f1-48755cceac25 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.088328 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f6e5-6310-4001-b6f1-48755cceac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.108124 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8019f6e5-6310-4001-b6f1-48755cceac25 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:13.109419 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8019f6e5-6310-4001-b6f1-48755cceac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:13.120131 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1455/2913] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:13.125892 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27067f1-b91f-4aec-95d1-a78d46957299 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:13.136500 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27067f1-b91f-4aec-95d1-a78d46957299 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:13.142616 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:13.143288 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.143592 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.143860 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.144587 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:46:13.144913 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:13.146520 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:13.158854 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1459/2914] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 12:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:46:13.163258 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019f6e5-6310-4001-b6f1-48755cceac25 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:13.172909 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019f6e5-6310-4001-b6f1-48755cceac25 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:13.178769 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:13.179415 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.179693 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.179996 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.180675 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:13.182592 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:13.211268 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1456/2915] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 12:46:13 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:46:13.215909 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:13.230773 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e667a4-710d-47c8-8219-bccd43b7d168 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:13.292689 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:13.293664 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.294049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.294407 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.295484 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:13.298406 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:13.324831 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1460/2916] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 12:46:13 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:46:13.329308 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:13.339866 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3e8ee-4fc7-43e8-825c-fc4dd1da1a51 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:13.345626 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:13.346274 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.346541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.346810 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.347527 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:13.349159 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:13.359861 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1457/2917] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:13.364315 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:13.374886 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15d14b-aedf-4c3d-88f3-235a10006c2c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:13.379993 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70cdc5-3e91-4777-856a-0b5376af1aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:13.380663 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70cdc5-3e91-4777-856a-0b5376af1aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.380954 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70cdc5-3e91-4777-856a-0b5376af1aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.381314 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70cdc5-3e91-4777-856a-0b5376af1aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.382049 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70cdc5-3e91-4777-856a-0b5376af1aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:13.383691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70cdc5-3e91-4777-856a-0b5376af1aa2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:13.393685 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1461/2918] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 12:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:46:13.397920 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:13.408283 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df104-828e-4071-83b9-9b3c8e54b99a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:13.413994 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:13.414923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.415204 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.415473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] PATH_INFO: `/v3/projects/7338ec13ca2e4596a509a96e0a2c1137/users/45c0718105774e1b9170fa0bc942c69e/roles/36180a439e5845b8b09129d2ba66c697` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.430267 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7338ec13ca2e4596a509a96e0a2c1137, user_id=45c0718105774e1b9170fa0bc942c69e, role_id=36180a439e5845b8b09129d2ba66c697)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:13.432936 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:13.447725 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1458/2919] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 12:46:13 2022] PUT /identity/v3/projects/7338ec13ca2e4596a509a96e0a2c1137/users/45c0718105774e1b9170fa0bc942c69e/roles/36180a439e5845b8b09129d2ba66c697 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:13.459294 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e459-4c18-4dec-897b-570ca3ede073 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.459579 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e459-4c18-4dec-897b-570ca3ede073 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.459850 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e459-4c18-4dec-897b-570ca3ede073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.501053 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7840e459-4c18-4dec-897b-570ca3ede073 None None] MFA Rules not processed for user `45c0718105774e1b9170fa0bc942c69e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:13.502767 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7840e459-4c18-4dec-897b-570ca3ede073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:13.577124 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1462/2920] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:13.589070 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:13.590828 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:13.651333 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:13.657055 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ba2d-3a94-4d8d-bc19-2c952f9fa1a1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:13.663034 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97755a1-6477-4882-82de-47e57a4e1393 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1470011d984f45be788072525f82cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:13.664205 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97755a1-6477-4882-82de-47e57a4e1393 service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:13.664572 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97755a1-6477-4882-82de-47e57a4e1393 service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:13.664899 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97755a1-6477-4882-82de-47e57a4e1393 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:13.675473 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97755a1-6477-4882-82de-47e57a4e1393 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:13.676923 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97755a1-6477-4882-82de-47e57a4e1393 service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:13.685919 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1459/2921] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:23.574328 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:23.681721 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:30.288693 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840e459-4c18-4dec-897b-570ca3ede073 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:30.360929 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840e459-4c18-4dec-897b-570ca3ede073 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:30.366216 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:30.367078 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:30.367359 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:30.367620 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] PATH_INFO: `/v3/users/45c0718105774e1b9170fa0bc942c69e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:30.368864 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c0718105774e1b9170fa0bc942c69e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:30.370791 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:30.422189 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c0718105774e1b9170fa0bc942c69e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:30.422863 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c0718105774e1b9170fa0bc942c69e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:30.433810 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c0718105774e1b9170fa0bc942c69e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:30.452174 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c0718105774e1b9170fa0bc942c69e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:30.459748 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c0718105774e1b9170fa0bc942c69e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:30.465921 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1463/2922] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 12:46:30 2022] DELETE /identity/v3/users/45c0718105774e1b9170fa0bc942c69e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:30.470577 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:30.471029 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:30.471120 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:30.488844 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] MFA Rules not processed for user `f3118ad2395a4a5ea5565be712f02917`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:46:30.490049 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:30.551911 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1460/2923] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 12:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:46:30.561754 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:30.563275 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:30.624874 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5579-a80c-4c0d-8a2c-f3af1a86cbf4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:30.629005 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb4c7ed74924ac4ad8f759437891569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:30.629640 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:30.629919 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:30.630224 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:30.640128 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:30.641647 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:30.651691 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1464/2924] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:46:30.923503 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:46:30.925110 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:46:30.940981 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706f605-715a-4c35-b62d-36a75c2411f7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:46:30.947056 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3118ad2395a4a5ea5565be712f02917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8b904bb5322427b8794f68069b5704c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:46:30.947924 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:46:30.948201 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:46:30.948552 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] PATH_INFO: `/v3/projects/7338ec13ca2e4596a509a96e0a2c1137` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:46:30.949841 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7338ec13ca2e4596a509a96e0a2c1137)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:46:30.951871 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:46:31.005498 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7338ec13ca2e4596a509a96e0a2c1137', 'request_id': 'req-054e9c3a-baa3-4c06-a643-9664813bc19e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:31.011897 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7338ec13ca2e4596a509a96e0a2c1137', 'request_id': 'req-054e9c3a-baa3-4c06-a643-9664813bc19e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:31.018541 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7338ec13ca2e4596a509a96e0a2c1137', 'request_id': 'req-054e9c3a-baa3-4c06-a643-9664813bc19e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:31.033178 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] The token cache is being invalidate because project 7338ec13ca2e4596a509a96e0a2c1137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:46:31.033458 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:31.034645 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-054e9c3a-baa3-4c06-a643-9664813bc19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:46:31.036440 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1461/2925] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 12:46:30 2022] DELETE /identity/v3/projects/7338ec13ca2e4596a509a96e0a2c1137 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:46:40.647442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:46:41.030426 dv-cinder-804035-46-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:50:12.113583 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:50:12.115151 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:50:12.208872 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42447c-8411-44a7-9330-52a97a0cab0f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:50:12.273907 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136cdc7-2f7d-47a5-ac38-015638189ac5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1c8f34e83d45c99e25f7fe3711e5da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5661cb1278b34280b8cd68754b5b1bfd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:50:12.274435 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136cdc7-2f7d-47a5-ac38-015638189ac5 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:50:12.274787 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136cdc7-2f7d-47a5-ac38-015638189ac5 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:50:12.275048 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136cdc7-2f7d-47a5-ac38-015638189ac5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:50:12.276967 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6136cdc7-2f7d-47a5-ac38-015638189ac5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:50:12.288442 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136cdc7-2f7d-47a5-ac38-015638189ac5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:50:12.290054 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136cdc7-2f7d-47a5-ac38-015638189ac5 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:50:12.299745 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1465/2926] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 12:50:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:50:22.295643 dv-cinder-804035-46-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=66 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}